Jun 03 11:43:12 devstack cinder-volume[75850]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75850) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 03 11:43:12 devstack cinder-volume[75850]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75850) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 03 11:43:12 devstack cinder-volume[75850]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75850) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 03 11:43:13 devstack cinder-volume[75850]: INFO dbcounter [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Registered counter for database cinder Jun 03 11:43:13 devstack cinder-volume[75850]: DEBUG oslo_db.sqlalchemy.engines [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75850) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 11:43:13 devstack cinder-volume[75850]: DEBUG dbcounter [-] [75850] Writer thread running {{(pid=75850) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 03 11:43:13 devstack cinder-volume[75850]: INFO cinder.rpc [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 03 11:43:13 devstack cinder-volume[75850]: INFO cinder.rpc [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 03 11:43:13 devstack cinder-volume[75850]: DEBUG oslo_db.sqlalchemy.engines [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75850) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 11:43:13 devstack cinder-volume[75850]: INFO cinder.volume.manager [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Determined volume DB was empty at startup. Jun 03 11:43:13 devstack cinder-volume[75850]: DEBUG cinder.volume.manager [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75850) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jun 03 11:43:13 devstack cinder-volume[75850]: INFO cinder.volume.manager [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 03 11:43:13 devstack cinder-volume[75850]: WARNING stevedore.named [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 03 11:43:13 devstack cinder-volume[75850]: WARNING castellan.key_manager [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 03 11:43:13 devstack cinder-volume[75850]: WARNING cinder.keymgr.conf_key_mgr [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG cinder.volume.drivers.lvm [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75850) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_concurrency.processutils [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75850) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_concurrency.processutils [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] CMD "cinder-rtstool verify" returned: 0 in 0.431s {{(pid=75850) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_db.sqlalchemy.engines [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75850) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 11:43:14 devstack cinder-volume[75850]: INFO cinder.rpc [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 03 11:43:14 devstack cinder-volume[75850]: INFO cinder.rpc [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 03 11:43:14 devstack cinder-volume[75850]: WARNING stevedore.named [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 03 11:43:14 devstack cinder-volume[75850]: WARNING castellan.key_manager [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 03 11:43:14 devstack cinder-volume[75850]: INFO cinder.volume.manager [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_db.sqlalchemy.engines [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75850) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 11:43:14 devstack cinder-volume[75850]: INFO oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Starting 1 workers Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Started child 76016 {{(pid=75850) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Full set of CONF: {{(pid=75850) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] ******************************************************************************** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Configuration options gathered from: {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] ================================================================================ {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] allow_availability_zone_fallback = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] allow_compression_on_image_upload = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] allowed_direct_url_schemes = [] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] api_rate_limit = True {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] auth_strategy = keystone {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] az_cache_duration = 3600 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_availability_zone = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_host = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_name = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_stats_polling_interval = 60 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[76016]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backup_api_class = cinder.backup.api.API {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backup_name_template = backup-%s {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backup_use_same_host = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backup_use_temp_snapshot = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] chap_password = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] chap_username = {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cinder_internal_tenant_project_id = 580c0e0796cb4da8803d5c7a943ffc4d {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cinder_internal_tenant_user_id = c2e888c64d7f48d9b3b3aaca9c09b5cc {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cloned_volume_same_az = True {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cluster = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] compression_format = gzip {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] compute_api_class = cinder.compute.nova.API {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] config_dir = [] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] config_source = [] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] control_exchange = openstack {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] debug = True {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] default_availability_zone = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] default_group_type = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] default_volume_type = lvmdriver-1 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] disk_geometry = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] driver_client_cert = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] driver_client_cert_key = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] driver_data_namespace = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] driver_ssl_cert_path = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] driver_ssl_cert_verify = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] driver_use_ssl = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] enable_force_upload = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] enable_new_services = True {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] enable_unsupported_driver = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] enforce_multipath_for_image_xfer = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] filter_function = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] glance_api_insecure = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] glance_api_servers = ['http://192.168.122.187/image'] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] glance_api_ssl_compression = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] glance_ca_certificates_file = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] glance_catalog_info = image:glance:publicURL {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] glance_certfile = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] glance_keyfile = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] glance_num_retries = 3 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] glance_request_timeout = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] goodness_function = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] graceful_shutdown_timeout = 5 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] group_api_class = cinder.group.api.API {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] host = devstack {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] image_compress_on_upload = True {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] image_conversion_address_space_limit = 1 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] image_conversion_cpu_limit = 60 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] image_conversion_disable = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] image_upload_use_cinder_backend = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] image_upload_use_internal_tenant = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] image_volume_cache_enabled = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] image_volume_cache_max_count = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] image_volume_cache_max_size_gb = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] init_host_max_objects_retrieval = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] instance_format = [instance: %(uuid)s] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] iscsi_target_flags = {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] iscsi_write_cache = on {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] iser_helper = tgtadm {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] iser_ip_address = 192.168.122.187 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] iser_port = 3260 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] log_color = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] log_config_append = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] log_dir = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] log_file = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] log_options = True {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] log_rotate_interval = 1 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] log_rotate_interval_type = days {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] log_rotation_type = none {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] max_age = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] max_logfile_count = 30 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] max_logfile_size_mb = 200 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] max_over_subscription_ratio = 20.0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] message_reap_interval = 86400 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] message_ttl = 2592000 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] migration_create_volume_timeout_secs = 300 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] monkey_patch = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] monkey_patch_modules = [] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] my_ip = 192.168.122.187 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] no_snapshot_gb_quota = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] num_iser_scan_tries = 3 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] num_shell_tries = 3 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] num_volume_device_scan_tries = 3 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] nvmeof_conn_info_version = 1 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] nvmet_ns_id = 10 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] nvmet_port_id = 1 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] osapi_max_limit = 1000 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] osapi_volume_ext_list = [] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] osapi_volume_listen_port = 8776 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] osapi_volume_use_ssl = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] osapi_volume_workers = 2 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[76016]: INFO cinder.volume.manager [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] per_volume_size_limit = -1 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] periodic_fuzzy_delay = 60 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] periodic_interval = 60 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] public_endpoint = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] publish_errors = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] quota_backup_gigabytes = 1000 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] quota_backups = 10 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] quota_gigabytes = 1000 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] quota_groups = 10 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] quota_snapshots = 10 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] quota_volumes = 10 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] rate_limit_burst = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] rate_limit_except_level = CRITICAL {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] rate_limit_interval = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] reinit_driver_count = 3 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] replication_device = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] report_discard_supported = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] report_interval = 120 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] reservation_clean_interval = 86400 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] reservation_expire = 86400 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] reserved_image_namespaces = [] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] reserved_percentage = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] rpc_response_timeout = 120 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] run_external_periodic_tasks = True {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] scst_target_driver = iscsi {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] scst_target_iqn_name = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] service_down_time = 720 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] shell_completion = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] snapshot_name_template = snapshot-%s {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] snapshot_same_host = True {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] split_loggers = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] state_path = /opt/stack/data/cinder {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] storage_availability_zone = nova {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] storage_protocol = iSCSI {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] syslog_log_facility = LOG_USER {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] target_helper = lioadm {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] target_ip_address = 192.168.122.187 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] target_port = 3260 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] target_protocol = iscsi {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] target_secondary_ip_addresses = [] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] trace_flags = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] transport_url = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] until_refresh = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] use_chap_auth = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] use_default_quota_class = True {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] use_journal = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] use_json = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] use_multipath_for_image_xfer = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] use_stderr = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] use_syslog = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] verify_glance_signatures = enabled {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] volume_api_class = cinder.volume.api.API {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] volume_backend_name = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] volume_clear = zero {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] volume_clear_ionice = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] volume_clear_size = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:14 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] volume_copy_bps_limit = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] volume_dd_blocksize = 1M {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] volume_name_template = volume-%s {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] volume_service_inithost_offload = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] volume_usage_audit_period = month {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] zoning_mode = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_concurrency.disable_process_locking = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.admin_password = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.admin_token = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.admin_user = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.auth_port = 35357 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.auth_protocol = https {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.auth_section = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.auth_type = password {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.auth_uri = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.auth_version = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.cache = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.certfile = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.identity_uri = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.include_service_catalog = True {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.insecure = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.interface = public {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.keyfile = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.memcache_password = {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.memcache_username = {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.region_name = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.service_type = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.187/identity {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.backend = dogpile.cache.null {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.backend_argument = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.backend_expiration_time = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.config_prefix = cache.oslo {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.debug_cache_backend = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.enable_retry_client = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.enable_socket_keepalive = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.enabled = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.enforce_fips_mode = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack sudo[76021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.expiration_time = 600 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.hashclient_retry_attempts = 2 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.memcache_dead_retry = 300 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack sudo[76021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.memcache_pool_maxsize = 10 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.memcache_sasl_enabled = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.password = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.proxies = [] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.redis_db = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.redis_server = localhost:6379 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.retry_attempts = 2 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.retry_delay = 0.0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.socket_keepalive_count = 1 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.socket_keepalive_idle = 1 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.socket_keepalive_interval = 1 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.socket_timeout = 1.0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.tls_allowed_ciphers = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.tls_cafile = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.tls_certfile = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.tls_enabled = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.tls_keyfile = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cache.username = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] coordination.backend_url = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.asyncio_connection = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.asyncio_slave_connection = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.backend = sqlalchemy {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.connection = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.connection_debug = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.connection_parameters = {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.connection_recycle_time = 3600 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.connection_trace = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.db_inc_retry_interval = True {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.db_max_retries = 20 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.db_max_retry_interval = 10 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.db_retry_interval = 1 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.max_overflow = 50 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.max_pool_size = 5 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.max_retries = 10 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.mysql_wsrep_sync_wait = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.pool_timeout = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.retry_interval = 10 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.slave_connection = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.sqlite_synchronous = True {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.synchronous_reader = True {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] database.use_db_reconnect = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] profiler.connection_string = messaging:// {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] profiler.enabled = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] profiler.es_doc_type = notification {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] profiler.es_scroll_size = 10000 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] profiler.es_scroll_time = 2m {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] profiler.filter_error_trace = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] profiler.hmac_keys = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] profiler.sentinel_service_name = mymaster {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] profiler.socket_timeout = 0.1 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] profiler.trace_requests = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] profiler.trace_sqlalchemy = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] profiler_jaeger.process_tags = {} {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] profiler_jaeger.service_name_prefix = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] profiler_otlp.service_name_prefix = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_policy.enforce_new_defaults = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: WARNING oslo_config.cfg [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_policy.enforce_scope = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_policy.policy_default_rule = default {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_policy.policy_file = policy.yaml {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] privsep_osbrick.group = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] privsep_osbrick.helper_command = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] privsep_osbrick.user = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cinder_sys_admin.group = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cinder_sys_admin.helper_command = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] cinder_sys_admin.user = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] service_user.auth_section = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] service_user.auth_type = password {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] service_user.cafile = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] service_user.certfile = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] service_user.collect_timing = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] service_user.insecure = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] service_user.keyfile = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] service_user.send_service_user_token = True {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] service_user.split_loggers = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] service_user.timeout = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] glance.auth_section = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] glance.auth_type = password {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] glance.certfile = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] glance.collect_timing = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] glance.insecure = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] glance.keyfile = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] glance.region_name = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] glance.split_loggers = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] glance.timeout = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.backend_availability_zone = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.chap_password = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.chap_username = {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.disk_geometry = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.driver_client_cert = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.driver_client_cert_key = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.driver_data_namespace = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.driver_use_ssl = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.extra_capabilities = {} {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.filter_function = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.goodness_function = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.iscsi_target_flags = {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.iscsi_write_cache = on {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.iser_helper = tgtadm {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.iser_ip_address = 192.168.122.187 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.iser_port = 3260 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.lvm_share_target = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.lvm_type = auto {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.num_shell_tries = 3 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.replication_device = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.report_discard_supported = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.reserved_percentage = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.target_helper = tgtadm {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.target_ip_address = 192.168.122.187 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.target_port = 3260 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.target_protocol = iscsi {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.trace_flags = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.unique_fqdn_network = True {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.use_chap_auth = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.volume_backend_name = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.volume_clear = zero {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.volume_clear_ionice = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.volume_clear_size = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_reports.file_event_handler = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_reports.log_dir = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.backend_host = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.chap_password = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.chap_username = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.disk_geometry = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.driver_client_cert = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.extra_capabilities = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.filter_function = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.goodness_function = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.iser_helper = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.iser_ip_address = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.iser_port = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.lvm_share_target = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.lvm_type = auto {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.num_shell_tries = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.replication_device = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.report_discard_supported = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.reserved_percentage = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.scst_target_driver = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.storage_protocol = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.target_helper = lioadm {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.target_ip_address = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.target_port = 3260 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.trace_flags = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.use_chap_auth = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.volume_clear = zero {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.volume_clear_size = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] lvmdriver-1.volumes_dir = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.ssl = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_notifications.driver = [] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_notifications.retry = -1 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] key_manager.fixed_key = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican.barbican_api_version = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican.barbican_endpoint = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican.barbican_endpoint_type = public {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican.barbican_region_name = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican.cafile = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican.certfile = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican.collect_timing = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican.insecure = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican.keyfile = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican.number_of_retries = 60 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican.retry_delay = 1 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican.send_service_user_token = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican.split_loggers = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican.timeout = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican.verify_ssl = True {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican.verify_ssl_path = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican_service_user.auth_section = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican_service_user.auth_type = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican_service_user.cafile = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican_service_user.certfile = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican_service_user.collect_timing = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican_service_user.insecure = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican_service_user.keyfile = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican_service_user.split_loggers = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] barbican_service_user.timeout = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] vault.approle_role_id = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] vault.approle_secret_id = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] vault.kv_mountpoint = secret {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] vault.kv_path = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] vault.kv_version = 2 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] vault.namespace = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] vault.root_token_id = **** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] vault.ssl_ca_crt_file = None {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] vault.timeout = 60.0 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] vault.use_ssl = False {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:43:14 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] ******************************************************************************** {{(pid=75850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 03 11:43:15 devstack sudo[76021]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:15 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.678s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:15 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:15 devstack sudo[76217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 11:43:15 devstack sudo[76217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:15 devstack sudo[76217]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:15 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.584s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:15 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 11:43:15 devstack cinder-volume[76016]: INFO cinder.brick.local_dev.lvm [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 03 11:43:15 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:15 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:15 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:16 devstack sudo[76402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 03 11:43:16 devstack sudo[76402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:16 devstack sudo[76402]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:16 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:16 devstack cinder-volume[76016]: DEBUG cinder.brick.local_dev.lvm [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76016) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 03 11:43:16 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:16 devstack sudo[76584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 11:43:16 devstack sudo[76584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:17 devstack sudo[76584]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:17 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.113s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:17 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:17 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:17 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:17 devstack sudo[76792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 11:43:17 devstack sudo[76792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:18 devstack sudo[76792]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:18 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.618s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:18 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:18 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:18 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:18 devstack sudo[76797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 03 11:43:18 devstack sudo[76797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:19 devstack sudo[76797]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:19 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.649s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:19 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:19 devstack sudo[76808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 03 11:43:19 devstack sudo[76808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:19 devstack sudo[76808]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:19 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:19 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:19 devstack sudo[76814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 03 11:43:19 devstack sudo[76814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:20 devstack sudo[76814]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:20 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.806s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:20 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:20 devstack sudo[76817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 11:43:20 devstack sudo[76817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:21 devstack sudo[76817]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:21 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.959s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:21 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:21 devstack sudo[76823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 11:43:21 devstack sudo[76823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:22 devstack sudo[76823]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:22 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.707s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:22 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:22 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:22 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:22 devstack sudo[76832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 11:43:22 devstack sudo[76832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:22 devstack sudo[76832]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:22 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.639s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:22 devstack cinder-volume[76016]: INFO cinder.volume.drivers.lvm [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 03 11:43:22 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:22 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:22 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:22 devstack sudo[76847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 11:43:22 devstack sudo[76847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:23 devstack sudo[76847]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:23 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.673s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:23 devstack cinder-volume[76016]: DEBUG cinder.volume.drivers.lvm [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Updating volume stats {{(pid=76016) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 03 11:43:23 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:23 devstack sudo[76959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 03 11:43:23 devstack sudo[76959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:24 devstack sudo[76959]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:24 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:24 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:24 devstack sudo[77077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 11:43:24 devstack sudo[77077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:24 devstack cinder-volume[75850]: DEBUG dbcounter [-] [75850] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75850) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:43:24 devstack sudo[77077]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:24 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:24 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:24 devstack sudo[77105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 11:43:24 devstack sudo[77105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:25 devstack sudo[77105]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:25 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.592s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:25 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:25 devstack sudo[77112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 11:43:25 devstack sudo[77112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:26 devstack sudo[77112]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:26 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:26 devstack cinder-volume[76016]: INFO cinder.volume.driver [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Driver hasn't implemented _init_vendor_properties() Jun 03 11:43:26 devstack cinder-volume[76016]: DEBUG cinder.volume.driver [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76016) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jun 03 11:43:26 devstack cinder-volume[76016]: DEBUG oslo_db.sqlalchemy.engines [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76016) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 11:43:26 devstack cinder-volume[76016]: DEBUG dbcounter [-] [76016] Writer thread running {{(pid=76016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 03 11:43:26 devstack cinder-volume[76016]: DEBUG cinder.db.sqlalchemy.api [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Building query based on filter {{(pid=76016) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jun 03 11:43:26 devstack cinder-volume[76016]: DEBUG cinder.image.image_utils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76016) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jun 03 11:43:26 devstack cinder-volume[76016]: INFO cinder.keymgr.migration [None req-27ab3b35-cdaf-4a95-b4bf-1e7d5279c42f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 03 11:43:26 devstack cinder-volume[76016]: DEBUG cinder.volume.drivers.lvm [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Updating volume stats {{(pid=76016) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 03 11:43:26 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:26 devstack sudo[77116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 03 11:43:26 devstack sudo[77116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:26 devstack sudo[77116]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:26 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:26 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:26 devstack sudo[77119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 11:43:26 devstack sudo[77119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:27 devstack sudo[77119]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:27 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:27 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:27 devstack sudo[77123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 11:43:27 devstack sudo[77123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:28 devstack sudo[77123]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:28 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.639s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:28 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:28 devstack sudo[77127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 11:43:28 devstack sudo[77127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:28 devstack sudo[77127]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:28 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:28 devstack cinder-volume[76016]: DEBUG cinder.manager [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Notifying Schedulers of capabilities ... {{(pid=76016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:43:28 devstack cinder-volume[76016]: INFO cinder.volume.manager [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Driver initialization completed successfully. Jun 03 11:43:28 devstack cinder-volume[76016]: INFO cinder.manager [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Initiating service 2 cleanup Jun 03 11:43:28 devstack cinder-volume[76016]: INFO cinder.manager [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Service 2 cleanup completed. Jun 03 11:43:28 devstack cinder-volume[76016]: DEBUG cinder.service [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Creating RPC server for service cinder-volume {{(pid=76016) start /opt/stack/cinder/cinder/service.py:231}} Jun 03 11:43:28 devstack cinder-volume[76016]: DEBUG cinder.service [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76016) start /opt/stack/cinder/cinder/service.py:237}} Jun 03 11:43:28 devstack cinder-volume[76016]: INFO cinder.volume.manager [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 03 11:43:28 devstack cinder-volume[76016]: DEBUG cinder.volume.drivers.lvm [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Updating volume stats {{(pid=76016) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 03 11:43:28 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:28 devstack sudo[77135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 03 11:43:28 devstack sudo[77135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:29 devstack sudo[77135]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:29 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.697s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:29 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:29 devstack sudo[77138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 11:43:29 devstack sudo[77138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:30 devstack sudo[77138]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:30 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.600s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:30 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:30 devstack sudo[77156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 11:43:30 devstack sudo[77156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:30 devstack sudo[77156]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:30 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.607s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:30 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:43:30 devstack sudo[77198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 11:43:30 devstack sudo[77198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:43:31 devstack sudo[77198]: pam_unix(sudo:session): session closed for user root Jun 03 11:43:31 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:43:31 devstack cinder-volume[76016]: INFO cinder.volume.manager [None req-b2e98177-22dc-479b-99a0-10482f57dd82 None None] Driver post RPC initialization completed successfully. Jun 03 11:43:41 devstack cinder-volume[76016]: DEBUG dbcounter [-] [76016] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:43:41 devstack cinder-volume[76016]: DEBUG dbcounter [-] [76016] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:45:05 devstack cinder-volume[76016]: DEBUG oslo_service.periodic_task [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 11:45:05 devstack cinder-volume[76016]: DEBUG cinder.volume.drivers.lvm [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] Updating volume stats {{(pid=76016) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 03 11:45:05 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:45:05 devstack sudo[81974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 03 11:45:05 devstack sudo[81974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:45:06 devstack sudo[81974]: pam_unix(sudo:session): session closed for user root Jun 03 11:45:06 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.601s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:45:06 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:45:06 devstack sudo[81985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 11:45:06 devstack sudo[81985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:45:06 devstack sudo[81985]: pam_unix(sudo:session): session closed for user root Jun 03 11:45:06 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.576s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:45:06 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:45:06 devstack sudo[81989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 11:45:06 devstack sudo[81989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:45:07 devstack sudo[81989]: pam_unix(sudo:session): session closed for user root Jun 03 11:45:07 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.616s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:45:07 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:45:07 devstack sudo[81999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 11:45:07 devstack sudo[81999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:45:07 devstack sudo[81999]: pam_unix(sudo:session): session closed for user root Jun 03 11:45:07 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.574s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:45:07 devstack cinder-volume[76016]: DEBUG cinder.manager [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] Notifying Schedulers of capabilities ... {{(pid=76016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:45:41 devstack cinder-volume[76016]: DEBUG dbcounter [-] [76016] Writing DB stats cinder:SELECT=1 {{(pid=76016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:45:41 devstack cinder-volume[76016]: DEBUG dbcounter [-] [76016] Writing DB stats cinder:UPDATE=1 {{(pid=76016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:46:05 devstack cinder-volume[76016]: DEBUG oslo_service.periodic_task [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 11:46:05 devstack cinder-volume[76016]: DEBUG cinder.volume.drivers.lvm [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] Updating volume stats {{(pid=76016) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 03 11:46:05 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:46:05 devstack sudo[83374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 03 11:46:05 devstack sudo[83374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:46:06 devstack sudo[83374]: pam_unix(sudo:session): session closed for user root Jun 03 11:46:06 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:46:06 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:46:06 devstack sudo[83414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 11:46:06 devstack sudo[83414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:46:06 devstack sudo[83414]: pam_unix(sudo:session): session closed for user root Jun 03 11:46:06 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.590s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:46:06 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:46:06 devstack sudo[83434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 11:46:06 devstack sudo[83434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:46:07 devstack sudo[83434]: pam_unix(sudo:session): session closed for user root Jun 03 11:46:07 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.599s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:46:07 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:46:07 devstack sudo[83478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 11:46:07 devstack sudo[83478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:46:07 devstack sudo[83478]: pam_unix(sudo:session): session closed for user root Jun 03 11:46:07 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.581s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:46:07 devstack cinder-volume[76016]: DEBUG cinder.manager [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] Notifying Schedulers of capabilities ... {{(pid=76016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:47:05 devstack cinder-volume[76016]: DEBUG oslo_service.periodic_task [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 11:47:05 devstack cinder-volume[76016]: DEBUG cinder.volume.drivers.lvm [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] Updating volume stats {{(pid=76016) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 03 11:47:05 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:47:05 devstack sudo[84805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 03 11:47:05 devstack sudo[84805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:47:06 devstack sudo[84805]: pam_unix(sudo:session): session closed for user root Jun 03 11:47:06 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.570s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:47:06 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:47:06 devstack sudo[84824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 11:47:06 devstack sudo[84824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:47:06 devstack sudo[84824]: pam_unix(sudo:session): session closed for user root Jun 03 11:47:06 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.606s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:47:06 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:47:06 devstack sudo[84837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 03 11:47:06 devstack sudo[84837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:47:07 devstack sudo[84837]: pam_unix(sudo:session): session closed for user root Jun 03 11:47:07 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.672s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:47:07 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:47:07 devstack sudo[84866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 03 11:47:07 devstack sudo[84866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:47:07 devstack sudo[84866]: pam_unix(sudo:session): session closed for user root Jun 03 11:47:07 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.580s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:47:07 devstack cinder-volume[76016]: DEBUG cinder.manager [None req-59ca542a-d199-445a-9941-86ae222e3113 None None] Notifying Schedulers of capabilities ... {{(pid=76016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:47:41 devstack cinder-volume[76016]: DEBUG dbcounter [-] [76016] Writing DB stats cinder:SELECT=1 {{(pid=76016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:47:41 devstack cinder-volume[76016]: DEBUG dbcounter [-] [76016] Writing DB stats cinder:UPDATE=1 {{(pid=76016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:47:50 devstack cinder-volume[75850]: INFO oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Caught SIGTERM, stopping children Jun 03 11:47:50 devstack cinder-volume[75850]: DEBUG oslo_concurrency.lockutils [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Acquiring lock "singleton_lock" {{(pid=75850) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 03 11:47:50 devstack cinder-volume[75850]: DEBUG oslo_concurrency.lockutils [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Acquired lock "singleton_lock" {{(pid=75850) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 03 11:47:50 devstack cinder-volume[75850]: DEBUG oslo_concurrency.lockutils [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Releasing lock "singleton_lock" {{(pid=75850) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 03 11:47:50 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Stop services. {{(pid=75850) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 03 11:47:50 devstack cinder-volume[75850]: DEBUG oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Killing children. {{(pid=75850) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 03 11:47:50 devstack cinder-volume[75850]: INFO oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Waiting on 1 children to exit Jun 03 11:47:53 devstack cinder-volume[76016]: DEBUG oslo_concurrency.lockutils [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Acquiring lock "singleton_lock" {{(pid=76016) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 03 11:47:53 devstack cinder-volume[76016]: DEBUG oslo_concurrency.lockutils [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Acquired lock "singleton_lock" {{(pid=76016) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 03 11:47:53 devstack cinder-volume[76016]: DEBUG oslo_concurrency.lockutils [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Releasing lock "singleton_lock" {{(pid=76016) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 03 11:47:53 devstack cinder-volume[76016]: WARNING amqp [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 03 11:47:53 devstack cinder-volume[76016]: WARNING amqp [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 03 11:47:53 devstack cinder-volume[75850]: INFO oslo_service.backend._eventlet.service [None req-573f0188-bd02-4933-9cf3-499bbc4f0a06 None None] Child 76016 exited with status 0 Jun 03 11:47:56 devstack cinder-volume[85758]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85758) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 03 11:47:56 devstack cinder-volume[85758]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85758) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 03 11:47:56 devstack cinder-volume[85758]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85758) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 03 11:47:56 devstack cinder-volume[85758]: INFO dbcounter [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Registered counter for database cinder Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_db.sqlalchemy.engines [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85758) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG dbcounter [-] [85758] Writer thread running {{(pid=85758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 03 11:47:57 devstack cinder-volume[85758]: INFO cinder.rpc [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 03 11:47:57 devstack cinder-volume[85758]: INFO cinder.rpc [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_db.sqlalchemy.engines [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85758) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 11:47:57 devstack cinder-volume[85758]: INFO cinder.volume.manager [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Determined volume DB was empty at startup. Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG cinder.volume.manager [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85758) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jun 03 11:47:57 devstack cinder-volume[85758]: INFO cinder.volume.manager [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 03 11:47:57 devstack cinder-volume[85758]: WARNING stevedore.named [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 03 11:47:57 devstack cinder-volume[85758]: WARNING castellan.key_manager [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 03 11:47:57 devstack cinder-volume[85758]: WARNING cinder.keymgr.conf_key_mgr [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 03 11:47:57 devstack cinder-volume[85758]: INFO cinder.volume.manager [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_db.sqlalchemy.engines [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85758) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 11:47:57 devstack cinder-volume[85758]: INFO oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Starting 1 workers Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Started child 85972 {{(pid=85758) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Full set of CONF: {{(pid=85758) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] ******************************************************************************** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Configuration options gathered from: {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 03 11:47:57 devstack cinder-volume[85972]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] ================================================================================ {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] allow_availability_zone_fallback = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] allow_compression_on_image_upload = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] allowed_direct_url_schemes = [] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] api_rate_limit = True {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] auth_strategy = keystone {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_availability_zone = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_host = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_name = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_stats_polling_interval = 60 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backup_api_class = cinder.backup.api.API {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backup_name_template = backup-%s {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backup_use_same_host = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backup_use_temp_snapshot = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] chap_password = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] chap_username = {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cinder_internal_tenant_project_id = 580c0e0796cb4da8803d5c7a943ffc4d {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cinder_internal_tenant_user_id = c2e888c64d7f48d9b3b3aaca9c09b5cc {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cluster = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] compression_format = gzip {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] compute_api_class = cinder.compute.nova.API {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] config_dir = [] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] config_source = [] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] control_exchange = openstack {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] debug = True {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] default_availability_zone = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] default_group_type = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] default_volume_type = QuobyteHD {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] disk_geometry = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] driver_client_cert = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] driver_client_cert_key = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] driver_data_namespace = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] driver_ssl_cert_path = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] driver_ssl_cert_verify = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] driver_use_ssl = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] enable_new_services = True {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] enable_unsupported_driver = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] enabled_backends = ['QuobyteHD'] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] enforce_multipath_for_image_xfer = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] filter_function = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] glance_api_insecure = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] glance_api_servers = ['http://192.168.122.187/image'] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] glance_api_ssl_compression = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] glance_ca_certificates_file = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] glance_catalog_info = image:glance:publicURL {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85972]: INFO cinder.volume.manager [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] glance_certfile = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85972]: DEBUG cinder.volume.drivers.remotefs [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85972) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] glance_keyfile = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] glance_num_retries = 3 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] glance_request_timeout = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] goodness_function = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] graceful_shutdown_timeout = 5 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] group_api_class = cinder.group.api.API {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] host = devstack {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] image_compress_on_upload = True {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] image_conversion_address_space_limit = 1 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] image_conversion_cpu_limit = 60 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] image_conversion_disable = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] image_upload_use_cinder_backend = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] image_upload_use_internal_tenant = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] image_volume_cache_enabled = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] image_volume_cache_max_count = 0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] image_volume_cache_max_size_gb = 0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] init_host_max_objects_retrieval = 0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] instance_format = [instance: %(uuid)s] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] iscsi_target_flags = {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] iscsi_write_cache = on {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] iser_helper = tgtadm {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] iser_ip_address = 192.168.122.187 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] iser_port = 3260 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] log_color = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] log_config_append = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] log_dir = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] log_file = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] log_options = True {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] log_rotate_interval = 1 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] log_rotate_interval_type = days {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] log_rotation_type = none {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] max_age = 0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] max_logfile_count = 30 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] max_logfile_size_mb = 200 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] max_over_subscription_ratio = 20.0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] message_reap_interval = 86400 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] message_ttl = 2592000 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] migration_create_volume_timeout_secs = 300 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] monkey_patch = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] monkey_patch_modules = [] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] my_ip = 192.168.122.187 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] no_snapshot_gb_quota = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] num_iser_scan_tries = 3 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] num_shell_tries = 3 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] num_volume_device_scan_tries = 3 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] nvmeof_conn_info_version = 1 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] nvmet_ns_id = 10 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] nvmet_port_id = 1 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] osapi_max_limit = 1000 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] osapi_volume_ext_list = [] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] osapi_volume_listen_port = 8776 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] osapi_volume_use_ssl = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] osapi_volume_workers = 2 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] per_volume_size_limit = -1 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] periodic_fuzzy_delay = 60 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] periodic_interval = 60 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] public_endpoint = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] publish_errors = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] quota_backup_gigabytes = 1000 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] quota_backups = 10 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] quota_gigabytes = 1000 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] quota_groups = 10 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] quota_snapshots = 10 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] quota_volumes = 10 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] rate_limit_burst = 0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] rate_limit_except_level = CRITICAL {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] rate_limit_interval = 0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] reinit_driver_count = 3 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] replication_device = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] report_discard_supported = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] report_interval = 120 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] reservation_clean_interval = 86400 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] reservation_expire = 86400 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] reserved_image_namespaces = [] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] reserved_percentage = 0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] rpc_response_timeout = 120 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] run_external_periodic_tasks = True {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] scst_target_driver = iscsi {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] scst_target_iqn_name = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] service_down_time = 720 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] shell_completion = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] snapshot_name_template = snapshot-%s {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] split_loggers = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] state_path = /opt/stack/data/cinder {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] storage_availability_zone = nova {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] storage_protocol = iSCSI {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] syslog_log_facility = LOG_USER {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] target_helper = lioadm {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] target_ip_address = 192.168.122.187 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] target_port = 3260 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] target_protocol = iscsi {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] target_secondary_ip_addresses = [] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] trace_flags = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] transport_url = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] until_refresh = 0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] use_chap_auth = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] use_default_quota_class = True {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] use_journal = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] use_json = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] use_multipath_for_image_xfer = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] use_stderr = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] use_syslog = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] verify_glance_signatures = enabled {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] volume_api_class = cinder.volume.api.API {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] volume_backend_name = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] volume_clear = zero {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] volume_clear_ionice = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] volume_clear_size = 0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] volume_copy_bps_limit = 0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] volume_dd_blocksize = 1M {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] volume_name_template = volume-%s {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] volume_service_inithost_offload = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] volume_usage_audit_period = month {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] zoning_mode = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_concurrency.disable_process_locking = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.admin_password = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.admin_token = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.admin_user = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.auth_admin_prefix = {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.auth_port = 35357 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.auth_protocol = https {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.auth_section = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.auth_type = password {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.auth_uri = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.auth_version = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.cache = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.certfile = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.identity_uri = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.include_service_catalog = True {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.insecure = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.interface = public {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.keyfile = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.memcache_password = {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85972]: DEBUG cinder.volume.drivers.quobyte [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85972) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 03 11:47:57 devstack cinder-volume[85972]: WARNING cinder.volume.drivers.quobyte [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85972]: WARNING cinder.volume.drivers.quobyte [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85972]: DEBUG oslo_concurrency.processutils [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Running cmd (subprocess): mount.quobyte {{(pid=85972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.memcache_username = {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.region_name = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.service_token_roles_required = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.service_type = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.187/identity {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.backend = dogpile.cache.null {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.backend_argument = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.backend_expiration_time = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.config_prefix = cache.oslo {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.debug_cache_backend = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.enable_retry_client = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.enable_socket_keepalive = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.enabled = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.enforce_fips_mode = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.expiration_time = 600 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.hashclient_retry_attempts = 2 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.memcache_dead_retry = 300 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.memcache_pool_maxsize = 10 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.memcache_sasl_enabled = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.password = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.proxies = [] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.redis_db = 0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.redis_server = localhost:6379 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.retry_attempts = 2 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.retry_delay = 0.0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.socket_keepalive_count = 1 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.socket_keepalive_idle = 1 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.socket_keepalive_interval = 1 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.socket_timeout = 1.0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.tls_allowed_ciphers = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.tls_cafile = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.tls_certfile = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.tls_enabled = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.tls_keyfile = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cache.username = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] coordination.backend_url = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.asyncio_connection = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.asyncio_slave_connection = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.backend = sqlalchemy {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.connection = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.connection_debug = 0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.connection_parameters = {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.connection_recycle_time = 3600 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.connection_trace = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.db_inc_retry_interval = True {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.db_max_retries = 20 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.db_max_retry_interval = 10 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.db_retry_interval = 1 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.max_overflow = 50 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.max_pool_size = 5 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.max_retries = 10 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.mysql_wsrep_sync_wait = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.pool_timeout = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.retry_interval = 10 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.slave_connection = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.sqlite_synchronous = True {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.synchronous_reader = True {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] database.use_db_reconnect = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] profiler.connection_string = messaging:// {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] profiler.enabled = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] profiler.es_doc_type = notification {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] profiler.es_scroll_size = 10000 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] profiler.es_scroll_time = 2m {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] profiler.filter_error_trace = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] profiler.hmac_keys = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] profiler.sentinel_service_name = mymaster {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] profiler.socket_timeout = 0.1 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] profiler.trace_requests = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] profiler.trace_sqlalchemy = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] profiler_jaeger.process_tags = {} {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] profiler_jaeger.service_name_prefix = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] profiler_otlp.service_name_prefix = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_policy.enforce_new_defaults = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: WARNING oslo_config.cfg [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_policy.enforce_scope = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_policy.policy_default_rule = default {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_policy.policy_file = policy.yaml {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] privsep_osbrick.group = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] privsep_osbrick.helper_command = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] privsep_osbrick.user = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cinder_sys_admin.group = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cinder_sys_admin.helper_command = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] cinder_sys_admin.user = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] service_user.auth_section = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] service_user.auth_type = password {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] service_user.cafile = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] service_user.certfile = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] service_user.collect_timing = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] service_user.insecure = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] service_user.keyfile = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] service_user.send_service_user_token = True {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] service_user.split_loggers = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] service_user.timeout = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] glance.auth_section = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] glance.auth_type = password {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] glance.certfile = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] glance.collect_timing = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] glance.insecure = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] glance.keyfile = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] glance.region_name = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] glance.split_loggers = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] glance.timeout = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.backend_availability_zone = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.chap_password = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.chap_username = {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.disk_geometry = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.driver_client_cert = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.driver_client_cert_key = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.driver_data_namespace = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.driver_use_ssl = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.extra_capabilities = {} {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.filter_function = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.goodness_function = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.iscsi_target_flags = {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.iscsi_write_cache = on {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.iser_helper = tgtadm {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.iser_ip_address = 192.168.122.187 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.iser_port = 3260 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.nas_host = {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.nas_login = admin {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.nas_mount_options = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.nas_password = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.nas_private_key = {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.nas_share_path = {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.num_shell_tries = 3 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.quobyte_volume_url = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.replication_device = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.report_discard_supported = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.reserved_percentage = 0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.target_helper = tgtadm {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.target_ip_address = 192.168.122.187 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.target_port = 3260 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.target_protocol = iscsi {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.trace_flags = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.unique_fqdn_network = True {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.use_chap_auth = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.volume_backend_name = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.volume_clear = zero {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.volume_clear_ionice = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.volume_clear_size = 0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_reports.file_event_handler = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_reports.log_dir = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.backend_availability_zone = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.backend_host = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.chap_password = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.chap_username = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.chiscsi_conf = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.disk_geometry = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.driver_client_cert = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.driver_data_namespace = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.driver_use_ssl = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.extra_capabilities = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.filter_function = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.goodness_function = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.iser_helper = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.iser_ip_address = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.iser_port = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.iser_target_prefix = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.nas_host = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.nas_login = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.nas_mount_options = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.nas_password = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.nas_private_key = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.nas_share_path = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.nas_ssh_port = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.num_shell_tries = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.nvmet_port_id = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack quobyte-client[85973]: Reading configuration file: /etc/quobyte/client.cfg Jun 03 11:47:57 devstack quobyte-client[85973]: Invalid parameters found, error: missing mount point. Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack quobyte-client[85973]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.replication_device = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.report_discard_supported = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack quobyte-client[85973]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.reserved_percentage = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.scst_target_driver = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85972]: DEBUG oslo_concurrency.processutils [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] CMD "mount.quobyte" returned: 1 in 0.191s {{(pid=85972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.storage_protocol = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85972]: DEBUG oslo_concurrency.lockutils [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85972]: DEBUG oslo_concurrency.lockutils [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.target_helper = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.target_ip_address = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.target_port = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85972]: DEBUG cinder.volume.drivers.quobyte [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=85972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:47:57 devstack cinder-volume[85972]: INFO cinder.volume.drivers.quobyte [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 ... Jun 03 11:47:57 devstack cinder-volume[85972]: DEBUG oslo_concurrency.processutils [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 -c /etc/quobyte/client-cinder.cfg {{(pid=85972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.target_prefix = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.target_protocol = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.trace_flags = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.use_chap_auth = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.volume_clear = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.volume_clear_size = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:57 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] QuobyteHD.volumes_dir = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.ssl = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_notifications.driver = [] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_notifications.retry = -1 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack sudo[85975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 -c /etc/quobyte/client-cinder.cfg Jun 03 11:47:58 devstack sudo[85975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] key_manager.fixed_key = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican.barbican_api_version = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican.barbican_endpoint = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican.barbican_endpoint_type = public {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican.barbican_region_name = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican.cafile = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican.certfile = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican.collect_timing = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican.insecure = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican.keyfile = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican.number_of_retries = 60 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican.retry_delay = 1 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican.send_service_user_token = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican.split_loggers = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican.timeout = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican.verify_ssl = True {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican.verify_ssl_path = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican_service_user.auth_section = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican_service_user.auth_type = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican_service_user.cafile = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican_service_user.certfile = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican_service_user.collect_timing = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican_service_user.insecure = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican_service_user.keyfile = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican_service_user.split_loggers = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] barbican_service_user.timeout = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] vault.approle_role_id = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] vault.approle_secret_id = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] vault.kv_mountpoint = secret {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] vault.kv_path = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] vault.kv_version = 2 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] vault.namespace = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] vault.root_token_id = **** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] vault.ssl_ca_crt_file = None {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] vault.timeout = 60.0 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] vault.use_ssl = False {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:47:58 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] ******************************************************************************** {{(pid=85758) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 03 11:47:58 devstack sudo[85975]: pam_unix(sudo:session): session closed for user root Jun 03 11:47:58 devstack cinder-volume[85972]: DEBUG oslo_concurrency.processutils [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.811s {{(pid=85972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:47:58 devstack cinder-volume[85972]: INFO cinder.volume.drivers.quobyte [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 succeeded Jun 03 11:47:58 devstack cinder-volume[85972]: DEBUG cinder.volume.drivers.quobyte [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=85972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:47:58 devstack cinder-volume[85972]: DEBUG oslo_concurrency.lockutils [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.826s {{(pid=85972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:47:58 devstack cinder-volume[85972]: DEBUG oslo_concurrency.processutils [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=85972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:47:58 devstack sudo[86048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:47:58 devstack sudo[86048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:47:59 devstack sudo[86048]: pam_unix(sudo:session): session closed for user root Jun 03 11:47:59 devstack cinder-volume[85972]: DEBUG oslo_concurrency.processutils [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.571s {{(pid=85972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:47:59 devstack cinder-volume[85972]: INFO cinder.volume.driver [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Driver hasn't implemented _init_vendor_properties() Jun 03 11:47:59 devstack cinder-volume[85972]: DEBUG cinder.volume.driver [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.727294921875, 'free_capacity_gb': 1775.727294921875, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85972) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jun 03 11:47:59 devstack cinder-volume[85972]: DEBUG oslo_db.sqlalchemy.engines [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 11:47:59 devstack cinder-volume[85972]: DEBUG dbcounter [-] [85972] Writer thread running {{(pid=85972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 03 11:47:59 devstack cinder-volume[85972]: DEBUG cinder.db.sqlalchemy.api [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Building query based on filter {{(pid=85972) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jun 03 11:47:59 devstack cinder-volume[85972]: DEBUG cinder.image.image_utils [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85972) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jun 03 11:47:59 devstack cinder-volume[85972]: INFO cinder.keymgr.migration [None req-2605ddfb-2dc7-489c-bbb6-8eb092c16994 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 03 11:47:59 devstack cinder-volume[85972]: DEBUG oslo_concurrency.lockutils [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:47:59 devstack cinder-volume[85972]: DEBUG oslo_concurrency.lockutils [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:47:59 devstack cinder-volume[85972]: DEBUG cinder.volume.drivers.quobyte [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=85972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:47:59 devstack cinder-volume[85972]: DEBUG cinder.volume.drivers.quobyte [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=85972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:47:59 devstack cinder-volume[85972]: DEBUG oslo_concurrency.lockutils [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:47:59 devstack cinder-volume[85972]: DEBUG oslo_concurrency.processutils [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=85972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:47:59 devstack sudo[86052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:47:59 devstack sudo[86052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:48:00 devstack sudo[86052]: pam_unix(sudo:session): session closed for user root Jun 03 11:48:00 devstack cinder-volume[85972]: DEBUG oslo_concurrency.processutils [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.639s {{(pid=85972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:48:00 devstack cinder-volume[85972]: DEBUG cinder.manager [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Notifying Schedulers of capabilities ... {{(pid=85972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:48:00 devstack cinder-volume[85972]: INFO cinder.volume.manager [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Driver initialization completed successfully. Jun 03 11:48:00 devstack cinder-volume[85972]: INFO cinder.manager [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Initiating service 3 cleanup Jun 03 11:48:00 devstack cinder-volume[85972]: INFO cinder.manager [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Service 3 cleanup completed. Jun 03 11:48:00 devstack cinder-volume[85972]: DEBUG cinder.service [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Creating RPC server for service cinder-volume {{(pid=85972) start /opt/stack/cinder/cinder/service.py:231}} Jun 03 11:48:00 devstack cinder-volume[85972]: DEBUG cinder.service [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85972) start /opt/stack/cinder/cinder/service.py:237}} Jun 03 11:48:00 devstack cinder-volume[85972]: INFO cinder.volume.manager [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 03 11:48:00 devstack cinder-volume[85972]: DEBUG oslo_concurrency.lockutils [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:48:00 devstack cinder-volume[85972]: DEBUG oslo_concurrency.lockutils [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:48:00 devstack cinder-volume[85972]: DEBUG cinder.volume.drivers.quobyte [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=85972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:48:00 devstack cinder-volume[85972]: DEBUG cinder.volume.drivers.quobyte [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=85972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:48:00 devstack cinder-volume[85972]: DEBUG oslo_concurrency.lockutils [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:48:00 devstack cinder-volume[85972]: DEBUG oslo_concurrency.processutils [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=85972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:48:00 devstack sudo[86061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:48:00 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:48:01 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root Jun 03 11:48:01 devstack cinder-volume[85972]: DEBUG oslo_concurrency.processutils [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.864s {{(pid=85972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:48:01 devstack cinder-volume[85972]: INFO cinder.volume.manager [None req-518efc77-71ef-4f3e-a2b3-3d75a91f2ce9 None None] Driver post RPC initialization completed successfully. Jun 03 11:48:05 devstack cinder-volume[85972]: DEBUG oslo_concurrency.lockutils [None req-19ebc6c0-e295-44b6-bdfa-55d66ba6d6da None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:48:05 devstack cinder-volume[85972]: DEBUG oslo_concurrency.lockutils [None req-19ebc6c0-e295-44b6-bdfa-55d66ba6d6da None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:48:05 devstack cinder-volume[85972]: DEBUG cinder.volume.drivers.quobyte [None req-19ebc6c0-e295-44b6-bdfa-55d66ba6d6da None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=85972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:48:05 devstack cinder-volume[85972]: DEBUG cinder.volume.drivers.quobyte [None req-19ebc6c0-e295-44b6-bdfa-55d66ba6d6da None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=85972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:48:05 devstack cinder-volume[85972]: DEBUG oslo_concurrency.lockutils [None req-19ebc6c0-e295-44b6-bdfa-55d66ba6d6da None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:48:05 devstack cinder-volume[85972]: DEBUG oslo_concurrency.processutils [None req-19ebc6c0-e295-44b6-bdfa-55d66ba6d6da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=85972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:48:05 devstack sudo[86261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:48:05 devstack sudo[86261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:48:05 devstack sudo[86261]: pam_unix(sudo:session): session closed for user root Jun 03 11:48:05 devstack cinder-volume[85972]: DEBUG oslo_concurrency.processutils [None req-19ebc6c0-e295-44b6-bdfa-55d66ba6d6da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.543s {{(pid=85972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:48:05 devstack cinder-volume[85972]: DEBUG cinder.manager [None req-19ebc6c0-e295-44b6-bdfa-55d66ba6d6da None None] Notifying Schedulers of capabilities ... {{(pid=85972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:48:07 devstack cinder-volume[85758]: DEBUG dbcounter [-] [85758] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:48:08 devstack cinder-volume[85758]: INFO oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Caught SIGTERM, stopping children Jun 03 11:48:08 devstack cinder-volume[85758]: DEBUG oslo_concurrency.lockutils [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Acquiring lock "singleton_lock" {{(pid=85758) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 03 11:48:08 devstack cinder-volume[85758]: DEBUG oslo_concurrency.lockutils [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Acquired lock "singleton_lock" {{(pid=85758) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 03 11:48:08 devstack cinder-volume[85758]: DEBUG oslo_concurrency.lockutils [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Releasing lock "singleton_lock" {{(pid=85758) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 03 11:48:08 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Stop services. {{(pid=85758) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 03 11:48:08 devstack cinder-volume[85758]: DEBUG oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Killing children. {{(pid=85758) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 03 11:48:08 devstack cinder-volume[85758]: INFO oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Waiting on 1 children to exit Jun 03 11:48:11 devstack cinder-volume[85972]: DEBUG dbcounter [-] [85972] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:48:11 devstack cinder-volume[85972]: DEBUG dbcounter [-] [85972] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=85972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:48:13 devstack cinder-volume[85972]: DEBUG oslo_concurrency.lockutils [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Acquiring lock "singleton_lock" {{(pid=85972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 03 11:48:13 devstack cinder-volume[85972]: DEBUG oslo_concurrency.lockutils [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Acquired lock "singleton_lock" {{(pid=85972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 03 11:48:13 devstack cinder-volume[85972]: DEBUG oslo_concurrency.lockutils [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Releasing lock "singleton_lock" {{(pid=85972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 03 11:48:13 devstack cinder-volume[85972]: WARNING amqp [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 03 11:48:13 devstack cinder-volume[85972]: WARNING amqp [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 03 11:48:13 devstack cinder-volume[85758]: INFO oslo_service.backend._eventlet.service [None req-a895ac70-a308-4565-99a1-920f66d22975 None None] Child 85972 exited with status 0 Jun 03 11:48:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86489) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 03 11:48:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86489) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 03 11:48:16 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86489) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 03 11:48:17 devstack cinder-volume[86489]: INFO dbcounter [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] Registered counter for database cinder Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_db.sqlalchemy.engines [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86489) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writer thread running {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 03 11:48:17 devstack cinder-volume[86489]: INFO cinder.rpc [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 03 11:48:17 devstack cinder-volume[86489]: INFO cinder.rpc [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_db.sqlalchemy.engines [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86489) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 11:48:17 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] Determined volume DB was empty at startup. Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG cinder.volume.manager [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86489) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jun 03 11:48:17 devstack cinder-volume[86489]: WARNING stevedore.named [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 03 11:48:17 devstack cinder-volume[86489]: WARNING castellan.key_manager [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 03 11:48:17 devstack cinder-volume[86489]: WARNING cinder.keymgr.conf_key_mgr [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 03 11:48:17 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_db.sqlalchemy.engines [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86489) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 11:48:17 devstack cinder-volume[86489]: INFO oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] Starting 1 workers Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] Started child 86724 {{(pid=86489) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] Full set of CONF: {{(pid=86489) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] ******************************************************************************** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] Configuration options gathered from: {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] ================================================================================ {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 03 11:48:17 devstack cinder-volume[86724]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] allow_availability_zone_fallback = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] allow_compression_on_image_upload = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] allowed_direct_url_schemes = [] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] api_rate_limit = True {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] auth_strategy = keystone {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_availability_zone = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_host = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_name = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_stats_polling_interval = 60 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backup_api_class = cinder.backup.api.API {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backup_name_template = backup-%s {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backup_use_same_host = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backup_use_temp_snapshot = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] chap_password = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] chap_username = {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cinder_internal_tenant_project_id = 580c0e0796cb4da8803d5c7a943ffc4d {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cinder_internal_tenant_user_id = c2e888c64d7f48d9b3b3aaca9c09b5cc {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cluster = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] compression_format = gzip {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] compute_api_class = cinder.compute.nova.API {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] config_dir = [] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] config_source = [] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] control_exchange = openstack {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] debug = True {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] default_availability_zone = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] default_group_type = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] default_volume_type = QuobyteHD {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] disk_geometry = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] driver_client_cert = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] driver_client_cert_key = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] driver_data_namespace = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] driver_ssl_cert_path = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] driver_ssl_cert_verify = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] driver_use_ssl = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] enable_new_services = True {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] enable_unsupported_driver = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] enabled_backends = ['QuobyteHD'] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] enforce_multipath_for_image_xfer = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] filter_function = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] glance_api_insecure = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] glance_api_servers = ['http://192.168.122.187/image'] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] glance_api_ssl_compression = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] glance_ca_certificates_file = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] glance_catalog_info = image:glance:publicURL {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] glance_certfile = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] glance_keyfile = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] glance_num_retries = 3 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] glance_request_timeout = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] goodness_function = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] graceful_shutdown_timeout = 5 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] group_api_class = cinder.group.api.API {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] host = devstack {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] image_compress_on_upload = True {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] image_conversion_address_space_limit = 1 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] image_conversion_cpu_limit = 60 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] image_conversion_disable = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] image_upload_use_cinder_backend = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] image_upload_use_internal_tenant = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] image_volume_cache_enabled = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] image_volume_cache_max_count = 0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] image_volume_cache_max_size_gb = 0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] init_host_max_objects_retrieval = 0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] instance_format = [instance: %(uuid)s] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] iscsi_target_flags = {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] iscsi_write_cache = on {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] iser_helper = tgtadm {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] iser_ip_address = 192.168.122.187 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] iser_port = 3260 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] log_color = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] log_config_append = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] log_dir = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] log_file = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] log_options = True {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] log_rotate_interval = 1 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] log_rotate_interval_type = days {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Starting volume driver QuobyteDriver (1.1.14) Jun 03 11:48:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86724) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] log_rotation_type = none {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] max_age = 0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] max_logfile_count = 30 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] max_logfile_size_mb = 200 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] max_over_subscription_ratio = 20.0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] message_reap_interval = 86400 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] message_ttl = 2592000 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] migration_create_volume_timeout_secs = 300 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] monkey_patch = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] monkey_patch_modules = [] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] my_ip = 192.168.122.187 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] no_snapshot_gb_quota = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] num_iser_scan_tries = 3 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] num_shell_tries = 3 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] num_volume_device_scan_tries = 3 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] nvmeof_conn_info_version = 1 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] nvmet_ns_id = 10 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] nvmet_port_id = 1 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] osapi_max_limit = 1000 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] osapi_volume_ext_list = [] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] osapi_volume_listen_port = 8776 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] osapi_volume_use_ssl = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] osapi_volume_workers = 2 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] per_volume_size_limit = -1 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] periodic_fuzzy_delay = 60 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] periodic_interval = 60 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] public_endpoint = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] publish_errors = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] quota_backup_gigabytes = 1000 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] quota_backups = 10 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] quota_gigabytes = 1000 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] quota_groups = 10 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] quota_snapshots = 10 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] quota_volumes = 10 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] rate_limit_burst = 0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] rate_limit_except_level = CRITICAL {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] rate_limit_interval = 0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] reinit_driver_count = 3 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] replication_device = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] report_discard_supported = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] report_interval = 120 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] reservation_clean_interval = 86400 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] reservation_expire = 86400 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] reserved_image_namespaces = [] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] reserved_percentage = 0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] rpc_response_timeout = 120 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] run_external_periodic_tasks = True {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] scst_target_driver = iscsi {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] scst_target_iqn_name = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] service_down_time = 720 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] shell_completion = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] snapshot_name_template = snapshot-%s {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] split_loggers = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] state_path = /opt/stack/data/cinder {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] storage_availability_zone = nova {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] storage_protocol = iSCSI {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] syslog_log_facility = LOG_USER {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] target_helper = lioadm {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] target_ip_address = 192.168.122.187 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] target_port = 3260 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] target_protocol = iscsi {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] target_secondary_ip_addresses = [] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] trace_flags = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] transport_url = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] until_refresh = 0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] use_chap_auth = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] use_default_quota_class = True {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] use_journal = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] use_json = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] use_multipath_for_image_xfer = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] use_stderr = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] use_syslog = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] verify_glance_signatures = enabled {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] volume_api_class = cinder.volume.api.API {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] volume_backend_name = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] volume_clear = zero {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] volume_clear_ionice = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] volume_clear_size = 0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] volume_copy_bps_limit = 0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] volume_dd_blocksize = 1M {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] volume_name_template = volume-%s {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] volume_service_inithost_offload = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] volume_usage_audit_period = month {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] zoning_mode = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_concurrency.disable_process_locking = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.admin_password = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.admin_token = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.admin_user = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.auth_admin_prefix = {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.auth_port = 35357 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.auth_protocol = https {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.auth_section = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.auth_type = password {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.auth_uri = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.auth_version = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.cache = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.certfile = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.identity_uri = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.include_service_catalog = True {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.insecure = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.interface = public {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.keyfile = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.memcache_password = {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.memcache_username = {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.region_name = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.service_token_roles_required = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.service_type = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.187/identity {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.backend = dogpile.cache.null {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.backend_argument = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.backend_expiration_time = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.config_prefix = cache.oslo {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.debug_cache_backend = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.enable_retry_client = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.enable_socket_keepalive = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.enabled = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.enforce_fips_mode = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.expiration_time = 600 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.hashclient_retry_attempts = 2 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.memcache_dead_retry = 300 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.memcache_pool_maxsize = 10 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.memcache_sasl_enabled = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.password = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.proxies = [] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.redis_db = 0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.redis_server = localhost:6379 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.retry_attempts = 2 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.retry_delay = 0.0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.socket_keepalive_count = 1 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.socket_keepalive_idle = 1 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.socket_keepalive_interval = 1 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.socket_timeout = 1.0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.tls_allowed_ciphers = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.tls_cafile = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.tls_certfile = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.tls_enabled = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.tls_keyfile = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cache.username = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] coordination.backend_url = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.asyncio_connection = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.asyncio_slave_connection = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.backend = sqlalchemy {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.connection = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.connection_debug = 0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.connection_parameters = {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.connection_recycle_time = 3600 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.connection_trace = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.db_inc_retry_interval = True {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.db_max_retries = 20 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.db_max_retry_interval = 10 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.db_retry_interval = 1 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.max_overflow = 50 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86724) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 03 11:48:17 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.quobyte [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.max_pool_size = 5 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.quobyte [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.max_retries = 10 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.mysql_wsrep_sync_wait = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.pool_timeout = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.retry_interval = 10 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.slave_connection = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Running cmd (subprocess): mount.quobyte {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.sqlite_synchronous = True {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.synchronous_reader = True {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] database.use_db_reconnect = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] profiler.connection_string = messaging:// {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] profiler.enabled = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] profiler.es_doc_type = notification {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] profiler.es_scroll_size = 10000 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] profiler.es_scroll_time = 2m {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] profiler.filter_error_trace = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] profiler.hmac_keys = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] profiler.sentinel_service_name = mymaster {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] profiler.socket_timeout = 0.1 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] profiler.trace_requests = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] profiler.trace_sqlalchemy = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] profiler_jaeger.process_tags = {} {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] profiler_jaeger.service_name_prefix = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] profiler_otlp.service_name_prefix = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_policy.enforce_new_defaults = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: WARNING oslo_config.cfg [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_policy.enforce_scope = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_policy.policy_default_rule = default {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_policy.policy_file = policy.yaml {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] privsep_osbrick.group = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] privsep_osbrick.helper_command = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] privsep_osbrick.user = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cinder_sys_admin.group = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cinder_sys_admin.helper_command = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] cinder_sys_admin.user = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] service_user.auth_section = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] service_user.auth_type = password {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] service_user.cafile = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] service_user.certfile = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] service_user.collect_timing = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] service_user.insecure = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] service_user.keyfile = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] service_user.send_service_user_token = True {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] service_user.split_loggers = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] service_user.timeout = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] glance.auth_section = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] glance.auth_type = password {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] glance.certfile = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] glance.collect_timing = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] glance.insecure = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] glance.keyfile = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] glance.region_name = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] glance.split_loggers = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] glance.timeout = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.backend_availability_zone = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.chap_password = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.chap_username = {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.disk_geometry = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.driver_client_cert = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.driver_client_cert_key = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.driver_data_namespace = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.driver_use_ssl = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.extra_capabilities = {} {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.filter_function = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.goodness_function = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.iscsi_target_flags = {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.iscsi_write_cache = on {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.iser_helper = tgtadm {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.iser_ip_address = 192.168.122.187 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.iser_port = 3260 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.nas_host = {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.nas_login = admin {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.nas_mount_options = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.nas_password = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.nas_private_key = {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.nas_share_path = {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.num_shell_tries = 3 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.quobyte_volume_url = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.replication_device = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.report_discard_supported = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.reserved_percentage = 0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.target_helper = tgtadm {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.target_ip_address = 192.168.122.187 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.target_port = 3260 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.target_protocol = iscsi {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.trace_flags = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.unique_fqdn_network = True {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.use_chap_auth = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.volume_backend_name = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.volume_clear = zero {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.volume_clear_ionice = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.volume_clear_size = 0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_reports.file_event_handler = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_reports.log_dir = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.backend_availability_zone = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.backend_host = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.chap_password = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.chap_username = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.chiscsi_conf = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.disk_geometry = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.driver_client_cert = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.driver_data_namespace = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.driver_use_ssl = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.extra_capabilities = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.filter_function = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.goodness_function = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.iser_helper = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.iser_ip_address = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.iser_port = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.iser_target_prefix = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.nas_host = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.nas_login = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.nas_mount_options = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.nas_password = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.nas_private_key = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack quobyte-client[86729]: Reading configuration file: /etc/quobyte/client.cfg Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.nas_share_path = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.nas_ssh_port = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack quobyte-client[86729]: Invalid parameters found, error: missing mount point. Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.num_shell_tries = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack quobyte-client[86729]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 03 11:48:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] CMD "mount.quobyte" returned: 1 in 0.068s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:48:17 devstack quobyte-client[86729]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.nvmet_port_id = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.replication_device = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.report_discard_supported = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.reserved_percentage = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.scst_target_driver = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.storage_protocol = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.target_helper = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.target_ip_address = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.target_port = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.target_prefix = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.target_protocol = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.trace_flags = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.use_chap_auth = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.volume_clear = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.volume_clear_size = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] QuobyteHD.volumes_dir = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.ssl = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_notifications.driver = [] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_notifications.retry = -1 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] key_manager.fixed_key = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican.barbican_api_version = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican.barbican_endpoint = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican.barbican_endpoint_type = public {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican.barbican_region_name = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican.cafile = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican.certfile = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican.collect_timing = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican.insecure = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican.keyfile = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican.number_of_retries = 60 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican.retry_delay = 1 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican.send_service_user_token = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican.split_loggers = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican.timeout = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican.verify_ssl = True {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican.verify_ssl_path = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican_service_user.auth_section = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican_service_user.auth_type = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican_service_user.cafile = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican_service_user.certfile = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack sudo[86732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican_service_user.collect_timing = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican_service_user.insecure = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican_service_user.keyfile = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican_service_user.split_loggers = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] barbican_service_user.timeout = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] vault.approle_role_id = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] vault.approle_secret_id = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] vault.kv_mountpoint = secret {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] vault.kv_path = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] vault.kv_version = 2 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] vault.namespace = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] vault.root_token_id = **** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] vault.ssl_ca_crt_file = None {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] vault.timeout = 60.0 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack sudo[86732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] vault.use_ssl = False {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 03 11:48:17 devstack cinder-volume[86489]: DEBUG oslo_service.backend._eventlet.service [None req-8132af95-dc45-4f24-acfd-19f66649bb43 None None] ******************************************************************************** {{(pid=86489) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 03 11:48:18 devstack sudo[86732]: pam_unix(sudo:session): session closed for user root Jun 03 11:48:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.594s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:48:18 devstack cinder-volume[86724]: INFO cinder.volume.driver [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Driver hasn't implemented _init_vendor_properties() Jun 03 11:48:18 devstack cinder-volume[86724]: DEBUG cinder.volume.driver [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7015228271484, 'free_capacity_gb': 1775.7015228271484, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86724) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jun 03 11:48:18 devstack cinder-volume[86724]: DEBUG oslo_db.sqlalchemy.engines [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86724) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 03 11:48:18 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writer thread running {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 03 11:48:18 devstack cinder-volume[86724]: DEBUG cinder.db.sqlalchemy.api [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Building query based on filter {{(pid=86724) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jun 03 11:48:18 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86724) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jun 03 11:48:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:48:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:48:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:48:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:48:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:48:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:48:18 devstack cinder-volume[86724]: INFO cinder.keymgr.migration [None req-99ca48bc-aa38-4807-930d-ee3a46fbf1f2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 03 11:48:18 devstack sudo[86742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:48:18 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:48:19 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root Jun 03 11:48:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.588s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:48:19 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:48:19 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Driver initialization completed successfully. Jun 03 11:48:19 devstack cinder-volume[86724]: INFO cinder.manager [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Initiating service 3 cleanup Jun 03 11:48:19 devstack cinder-volume[86724]: INFO cinder.manager [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Service 3 cleanup completed. Jun 03 11:48:19 devstack cinder-volume[86724]: DEBUG cinder.service [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Creating RPC server for service cinder-volume {{(pid=86724) start /opt/stack/cinder/cinder/service.py:231}} Jun 03 11:48:19 devstack cinder-volume[86724]: DEBUG cinder.service [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86724) start /opt/stack/cinder/cinder/service.py:237}} Jun 03 11:48:19 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 03 11:48:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:48:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:48:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:48:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:48:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:48:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:48:19 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:48:19 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:48:19 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Jun 03 11:48:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.601s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:48:19 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-76879b60-b851-48be-9648-7b55a4832c5f None None] Driver post RPC initialization completed successfully. Jun 03 11:48:27 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:48:29 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=1 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:48:29 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:49:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 11:49:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:49:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:49:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:49:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:49:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:49:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:49:36 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:49:36 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:49:39 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Jun 03 11:49:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 2.294s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:49:39 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Flow 'volume_create_manager' (21b0c53a-b958-46d1-b3f3-940fb4555c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de1c1c2-95b0-4596-858d-10ac91971084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de1c1c2-95b0-4596-858d-10ac91971084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-637499993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01577f57f714dc3b0e7f27d4ed93a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:49:40Z,use_quota=True,user_id='aa59b786f66d4a50bc9e08e6e7735d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1ddb7f-cb6b-4f36-9489-60928bafd777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1ddb7f-cb6b-4f36-9489-60928bafd777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87cb9973-e41e-4267-ad16-2d304d51fbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87cb9973-e41e-4267-ad16-2d304d51fbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3', 'volume_name': 'volume-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1870dd96-6724-4311-8ac0-e5d9434b491a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1870dd96-6724-4311-8ac0-e5d9434b491a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251734bb-51d4-45b9-ba33-b0c323140c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:49:40 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Volume 9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3', 'volume_size': 1} Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-637499993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01577f57f714dc3b0e7f27d4ed93a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:49:40Z,use_quota=True,user_id='aa59b786f66d4a50bc9e08e6e7735d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Creating volume 9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:49:40 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:49:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:49:40 devstack sudo[87375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3 1073741824 Jun 03 11:49:40 devstack sudo[87375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:49:43 devstack sudo[87375]: pam_unix(sudo:session): session closed for user root Jun 03 11:49:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3 1073741824" returned: 0 in 2.938s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:49:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:49:43 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3 Jun 03 11:49:43 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:49:45 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Jun 03 11:49:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3" returned: 0 in 2.122s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:49:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] <== create_volume: return (5271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:49:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.277s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:49:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251734bb-51d4-45b9-ba33-b0c323140c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:49:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e41c4948-96bb-4060-af83-af092371e59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:49:45 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Volume volume-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3 (9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3): created successfully Jun 03 11:49:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e41c4948-96bb-4060-af83-af092371e59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:49:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Flow 'volume_create_manager' (21b0c53a-b958-46d1-b3f3-940fb4555c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:49:46 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d49ebcaa-e934-481e-955b-ec510d99b2a6 tempest-DeleteServersTestJSON-1443782166 None] Created volume successfully. Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Flow 'volume_create_manager' (9eb3e8f7-29ac-4693-8460-a16f2576b5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52dcfcf2-e5f0-487b-8648-959063f244d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52dcfcf2-e5f0-487b-8648-959063f244d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1288915580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e20bc002-aa02-4e56-83fa-8237ae006192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359406eae7ef41cc8ad55306c6285060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:49:48Z,use_quota=True,user_id='ffb57f3021204433ba35a7cb2571ec3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2392df2-4c3b-4dc8-9e93-542940c0082d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2392df2-4c3b-4dc8-9e93-542940c0082d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d205f02-7b5f-4a20-939a-ffc720087966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d205f02-7b5f-4a20-939a-ffc720087966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e20bc002-aa02-4e56-83fa-8237ae006192', 'volume_name': 'volume-e20bc002-aa02-4e56-83fa-8237ae006192', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9862f5c2-c6aa-4493-bf91-0eeccce6f86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9862f5c2-c6aa-4493-bf91-0eeccce6f86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b30354c-6be0-4803-a2df-47a5ac94658c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:49:48 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Volume e20bc002-aa02-4e56-83fa-8237ae006192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e20bc002-aa02-4e56-83fa-8237ae006192', 'volume_size': 1} Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1288915580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e20bc002-aa02-4e56-83fa-8237ae006192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359406eae7ef41cc8ad55306c6285060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:49:48Z,use_quota=True,user_id='ffb57f3021204433ba35a7cb2571ec3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Creating volume e20bc002-aa02-4e56-83fa-8237ae006192 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:49:48 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:49:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e20bc002-aa02-4e56-83fa-8237ae006192 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:49:48 devstack sudo[87831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e20bc002-aa02-4e56-83fa-8237ae006192 1073741824 Jun 03 11:49:48 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:49:50 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root Jun 03 11:49:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e20bc002-aa02-4e56-83fa-8237ae006192 1073741824" returned: 0 in 1.921s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:49:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e20bc002-aa02-4e56-83fa-8237ae006192 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:49:50 devstack sudo[87847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e20bc002-aa02-4e56-83fa-8237ae006192 Jun 03 11:49:50 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:49:52 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root Jun 03 11:49:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e20bc002-aa02-4e56-83fa-8237ae006192" returned: 0 in 1.671s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:49:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] <== create_volume: return (3748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:49:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.752s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:49:52 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b30354c-6be0-4803-a2df-47a5ac94658c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e20bc002-aa02-4e56-83fa-8237ae006192', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:49:52 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3c2b07-387b-4477-b56c-f091be4f20c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:49:52 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Volume volume-e20bc002-aa02-4e56-83fa-8237ae006192 (e20bc002-aa02-4e56-83fa-8237ae006192): created successfully Jun 03 11:49:52 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3c2b07-387b-4477-b56c-f091be4f20c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:49:52 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Flow 'volume_create_manager' (9eb3e8f7-29ac-4693-8460-a16f2576b5e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:49:52 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-2e28880a-ba67-4832-87b5-365f36f54311 tempest-VolumesAdminNegativeTest-890711013 None] Created volume successfully. Jun 03 11:49:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Acquiring lock "cinder-e20bc002-aa02-4e56-83fa-8237ae006192-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:49:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Lock "cinder-e20bc002-aa02-4e56-83fa-8237ae006192-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:49:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Acquiring lock "cinder-quobyte-e20bc002-aa02-4e56-83fa-8237ae006192" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:49:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Lock "cinder-quobyte-e20bc002-aa02-4e56-83fa-8237ae006192" acquired by "delete_volume" :: waited 0.067s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:49:55 devstack cinder-volume[86724]: INFO oslo.privsep.daemon [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpdapnp_zn/privsep.sock'] Jun 03 11:49:55 devstack sudo[87935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpdapnp_zn/privsep.sock Jun 03 11:49:55 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:49:58 devstack cinder-volume[86724]: WARNING py.warnings [req-abef20b8-f387-48ae-8c39-e3dd1f16ff8a req-29a68b09-f935-4c0f-a181-2322838291f9 tempest-DeleteServersTestJSON-1443782166 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jun 03 11:49:58 devstack cinder-volume[86724]: .first() Jun 03 11:49:58 devstack cinder-volume[86724]: Jun 03 11:49:58 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root Jun 03 11:49:58 devstack cinder-volume[86724]: INFO oslo.privsep.daemon [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Spawned new privsep daemon via rootwrap Jun 03 11:49:58 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Accepted privsep connection to /tmp/tmpdapnp_zn/privsep.sock {{(pid=86724) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Jun 03 11:49:58 devstack cinder-volume[86724]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 03 11:49:58 devstack cinder-volume[86724]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 03 11:49:58 devstack cinder-volume[86724]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 03 11:49:58 devstack cinder-volume[86724]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87943 Jun 03 11:49:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-abef20b8-f387-48ae-8c39-e3dd1f16ff8a req-29a68b09-f935-4c0f-a181-2322838291f9 tempest-DeleteServersTestJSON-1443782166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:49:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-abef20b8-f387-48ae-8c39-e3dd1f16ff8a req-29a68b09-f935-4c0f-a181-2322838291f9 tempest-DeleteServersTestJSON-1443782166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:49:58 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e32588b-5f6e-4162-8f71-e69f30f4d75d]: (2,) {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:49:58 devstack cinder-volume[86724]: WARNING oslo_privsep.priv_context [req-abef20b8-f387-48ae-8c39-e3dd1f16ff8a req-29a68b09-f935-4c0f-a181-2322838291f9 tempest-DeleteServersTestJSON-1443782166 None] privsep daemon already running Jun 03 11:49:58 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[646e1f74-93e4-4f7d-9fe1-dcb6aaced89e]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:49:58 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[37db72f8-2ea7-4a7b-bbc5-f2e6dc45ca9a]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:49:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e20bc002-aa02-4e56-83fa-8237ae006192 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:49:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-abef20b8-f387-48ae-8c39-e3dd1f16ff8a req-29a68b09-f935-4c0f-a181-2322838291f9 tempest-DeleteServersTestJSON-1443782166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:49:59 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3 Jun 03 11:49:59 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:49:59 devstack sudo[87955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e20bc002-aa02-4e56-83fa-8237ae006192 Jun 03 11:49:59 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:50:00 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:50:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Flow 'volume_create_manager' (b1ffe83a-c900-42cc-a9c1-2b43029277d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:50:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8410b73-31a6-4cf3-8911-e8c78f3e1362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:50:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8410b73-31a6-4cf3-8911-e8c78f3e1362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-593341070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a879e8e5-ecb7-470c-8f72-295eee194f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fb99b002877451cb01baa0b473bc6a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:50:00Z,use_quota=True,user_id='97cc6c3c51674e5d8ca07273d5ea0411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:50:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0642ec8d-ea6c-4904-848a-2936f8ab3a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:50:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0642ec8d-ea6c-4904-848a-2936f8ab3a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:50:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219207ed-a127-4dcd-84b9-e9e66968cd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:50:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219207ed-a127-4dcd-84b9-e9e66968cd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a879e8e5-ecb7-470c-8f72-295eee194f18', 'volume_name': 'volume-a879e8e5-ecb7-470c-8f72-295eee194f18', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:50:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a39c1cb-3263-4934-afa5-e9c606b5d310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:50:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a39c1cb-3263-4934-afa5-e9c606b5d310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:50:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2474a235-54d3-485b-9f17-c5ad6a7b033a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:50:00 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Volume a879e8e5-ecb7-470c-8f72-295eee194f18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a879e8e5-ecb7-470c-8f72-295eee194f18', 'volume_size': 1} Jun 03 11:50:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:50:00 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root Jun 03 11:50:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e20bc002-aa02-4e56-83fa-8237ae006192" returned: 0 in 2.042s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:50:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e20bc002-aa02-4e56-83fa-8237ae006192 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:50:00 devstack sudo[87967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e20bc002-aa02-4e56-83fa-8237ae006192 Jun 03 11:50:00 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:50:00 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Jun 03 11:50:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-abef20b8-f387-48ae-8c39-e3dd1f16ff8a req-29a68b09-f935-4c0f-a181-2322838291f9 tempest-DeleteServersTestJSON-1443782166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3" returned: 0 in 2.132s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:50:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-abef20b8-f387-48ae-8c39-e3dd1f16ff8a req-29a68b09-f935-4c0f-a181-2322838291f9 tempest-DeleteServersTestJSON-1443782166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.239s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:50:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.541s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:50:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-593341070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a879e8e5-ecb7-470c-8f72-295eee194f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fb99b002877451cb01baa0b473bc6a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:50:00Z,use_quota=True,user_id='97cc6c3c51674e5d8ca07273d5ea0411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:50:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Creating volume a879e8e5-ecb7-470c-8f72-295eee194f18 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:50:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:50:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:50:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:50:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:50:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:50:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:50:01 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:50:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a879e8e5-ecb7-470c-8f72-295eee194f18 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:50:01 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a879e8e5-ecb7-470c-8f72-295eee194f18 1073741824 Jun 03 11:50:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-abef20b8-f387-48ae-8c39-e3dd1f16ff8a req-29a68b09-f935-4c0f-a181-2322838291f9 tempest-DeleteServersTestJSON-1443782166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a8f79b3-a916-4094-bbcf-80257d709705', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 11:50:01 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:50:01 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-abef20b8-f387-48ae-8c39-e3dd1f16ff8a req-29a68b09-f935-4c0f-a181-2322838291f9 tempest-DeleteServersTestJSON-1443782166 None] attachment_update completed successfully. Jun 03 11:50:03 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root Jun 03 11:50:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e20bc002-aa02-4e56-83fa-8237ae006192" returned: 0 in 2.292s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:50:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Lock "cinder-quobyte-e20bc002-aa02-4e56-83fa-8237ae006192" released by "delete_volume" :: held 8.185s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:50:03 devstack cinder-volume[86724]: WARNING cinder.quota [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:50:03 devstack cinder-volume[86724]: WARNING cinder.quota [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:50:03 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Created reservations ['2068def6-4119-4fb0-8799-c15a969744ab', 'a69390e7-8c21-43c5-a120-34a464dd4a59', 'fc0a425d-e283-45b5-913e-99e5b36a3281', 'f78ac092-8c5a-4767-b6ff-8d59ff9926af'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:50:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:50:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:50:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:50:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:50:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:50:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:50:03 devstack sudo[88074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:50:03 devstack sudo[88074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:50:03 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Jun 03 11:50:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a879e8e5-ecb7-470c-8f72-295eee194f18 1073741824" returned: 0 in 2.442s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:50:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a879e8e5-ecb7-470c-8f72-295eee194f18 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:50:03 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a879e8e5-ecb7-470c-8f72-295eee194f18 Jun 03 11:50:03 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:50:05 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Jun 03 11:50:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a879e8e5-ecb7-470c-8f72-295eee194f18" returned: 0 in 1.483s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:50:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] <== create_volume: return (4036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:50:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.043s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:50:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2474a235-54d3-485b-9f17-c5ad6a7b033a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a879e8e5-ecb7-470c-8f72-295eee194f18', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:50:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1124136f-f18e-43c3-8fc6-95c81783a01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:50:05 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Volume volume-a879e8e5-ecb7-470c-8f72-295eee194f18 (a879e8e5-ecb7-470c-8f72-295eee194f18): created successfully Jun 03 11:50:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1124136f-f18e-43c3-8fc6-95c81783a01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:50:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Flow 'volume_create_manager' (b1ffe83a-c900-42cc-a9c1-2b43029277d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:50:05 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-460d3510-716a-408e-913d-ad1297156f9f tempest-ServerRescueNegativeTestJSON-70291222 None] Created volume successfully. Jun 03 11:50:05 devstack sudo[88074]: pam_unix(sudo:session): session closed for user root Jun 03 11:50:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 2.143s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:50:05 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:50:05 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Deleted volume successfully. Jun 03 11:50:05 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2935e8b3-e260-4d0e-a65f-cfdef97bb580 tempest-VolumesAdminNegativeTest-890711013 None] Lock "cinder-e20bc002-aa02-4e56-83fa-8237ae006192-delete_volume" released by "delete_volume" :: held 10.753s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:50:13 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-d40f301c-212e-4a5d-bee4-9d1595b881d4 req-109586d2-60c0-4e88-9cbb-3017234e4680 tempest-DeleteServersTestJSON-1443782166 None] Terminate volume connection completed successfully. Jun 03 11:50:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-d40f301c-212e-4a5d-bee4-9d1595b881d4 req-109586d2-60c0-4e88-9cbb-3017234e4680 tempest-DeleteServersTestJSON-1443782166 None] Deleting attachment 0a8f79b3-a916-4094-bbcf-80257d709705. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 11:50:15 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=16,cinder:UPDATE=22,cinder:INSERT=2,cinder:DELETE=3 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:50:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c2b55588-909f-40d2-966c-7c3429170ab3 tempest-DeleteServersTestJSON-1443782166 None] Acquiring lock "cinder-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:50:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c2b55588-909f-40d2-966c-7c3429170ab3 tempest-DeleteServersTestJSON-1443782166 None] Lock "cinder-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:50:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c2b55588-909f-40d2-966c-7c3429170ab3 tempest-DeleteServersTestJSON-1443782166 None] Acquiring lock "cinder-quobyte-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:50:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c2b55588-909f-40d2-966c-7c3429170ab3 tempest-DeleteServersTestJSON-1443782166 None] Lock "cinder-quobyte-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3" acquired by "delete_volume" :: waited 0.049s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:50:18 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[025225fc-63e1-49a5-87ef-b0d571faf69b]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:50:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c2b55588-909f-40d2-966c-7c3429170ab3 tempest-DeleteServersTestJSON-1443782166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:50:19 devstack sudo[88697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3 Jun 03 11:50:19 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:50:20 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root Jun 03 11:50:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c2b55588-909f-40d2-966c-7c3429170ab3 tempest-DeleteServersTestJSON-1443782166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3" returned: 0 in 1.533s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:50:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c2b55588-909f-40d2-966c-7c3429170ab3 tempest-DeleteServersTestJSON-1443782166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:50:20 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3 Jun 03 11:50:20 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:50:21 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Jun 03 11:50:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c2b55588-909f-40d2-966c-7c3429170ab3 tempest-DeleteServersTestJSON-1443782166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3" returned: 0 in 0.874s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:50:21 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c2b55588-909f-40d2-966c-7c3429170ab3 tempest-DeleteServersTestJSON-1443782166 None] Lock "cinder-quobyte-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3" released by "delete_volume" :: held 2.521s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:50:21 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-c2b55588-909f-40d2-966c-7c3429170ab3 tempest-DeleteServersTestJSON-1443782166 None] Created reservations ['5dfe754c-79bc-431a-bdb4-34d544f51897', '71ee3f04-e952-4af1-9054-b8af93d18d19', '782dda7f-7fe1-490b-a6f5-9f582cf1441e', '4bf98c62-ad0a-4405-bc5d-58bb3a4970d4'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:50:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c2b55588-909f-40d2-966c-7c3429170ab3 tempest-DeleteServersTestJSON-1443782166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:50:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c2b55588-909f-40d2-966c-7c3429170ab3 tempest-DeleteServersTestJSON-1443782166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:50:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c2b55588-909f-40d2-966c-7c3429170ab3 tempest-DeleteServersTestJSON-1443782166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:50:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c2b55588-909f-40d2-966c-7c3429170ab3 tempest-DeleteServersTestJSON-1443782166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:50:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c2b55588-909f-40d2-966c-7c3429170ab3 tempest-DeleteServersTestJSON-1443782166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:50:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c2b55588-909f-40d2-966c-7c3429170ab3 tempest-DeleteServersTestJSON-1443782166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:50:21 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:50:21 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:50:22 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Jun 03 11:50:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c2b55588-909f-40d2-966c-7c3429170ab3 tempest-DeleteServersTestJSON-1443782166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.983s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:50:22 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-c2b55588-909f-40d2-966c-7c3429170ab3 tempest-DeleteServersTestJSON-1443782166 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:50:22 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c2b55588-909f-40d2-966c-7c3429170ab3 tempest-DeleteServersTestJSON-1443782166 None] Deleted volume successfully. Jun 03 11:50:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c2b55588-909f-40d2-966c-7c3429170ab3 tempest-DeleteServersTestJSON-1443782166 None] Lock "cinder-9e3acaf3-57c8-4e0b-8124-b2f411a8e2c3-delete_volume" released by "delete_volume" :: held 4.090s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:50:31 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=25,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:50:32 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:50:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c34e1a78-4055-4136-986e-5f9f098b57d0 tempest-ServerRescueNegativeTestJSON-70291222 None] Acquiring lock "cinder-a879e8e5-ecb7-470c-8f72-295eee194f18-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:50:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c34e1a78-4055-4136-986e-5f9f098b57d0 tempest-ServerRescueNegativeTestJSON-70291222 None] Lock "cinder-a879e8e5-ecb7-470c-8f72-295eee194f18-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:50:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c34e1a78-4055-4136-986e-5f9f098b57d0 tempest-ServerRescueNegativeTestJSON-70291222 None] Acquiring lock "cinder-quobyte-a879e8e5-ecb7-470c-8f72-295eee194f18" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:50:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c34e1a78-4055-4136-986e-5f9f098b57d0 tempest-ServerRescueNegativeTestJSON-70291222 None] Lock "cinder-quobyte-a879e8e5-ecb7-470c-8f72-295eee194f18" acquired by "delete_volume" :: waited 0.029s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:50:34 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31b4d38-da59-4a69-927d-20f2db3eb4d7]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:50:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c34e1a78-4055-4136-986e-5f9f098b57d0 tempest-ServerRescueNegativeTestJSON-70291222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a879e8e5-ecb7-470c-8f72-295eee194f18 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:50:34 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a879e8e5-ecb7-470c-8f72-295eee194f18 Jun 03 11:50:34 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:50:35 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Jun 03 11:50:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c34e1a78-4055-4136-986e-5f9f098b57d0 tempest-ServerRescueNegativeTestJSON-70291222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a879e8e5-ecb7-470c-8f72-295eee194f18" returned: 0 in 1.082s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:50:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c34e1a78-4055-4136-986e-5f9f098b57d0 tempest-ServerRescueNegativeTestJSON-70291222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a879e8e5-ecb7-470c-8f72-295eee194f18 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:50:35 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a879e8e5-ecb7-470c-8f72-295eee194f18 Jun 03 11:50:35 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:50:36 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Jun 03 11:50:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c34e1a78-4055-4136-986e-5f9f098b57d0 tempest-ServerRescueNegativeTestJSON-70291222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a879e8e5-ecb7-470c-8f72-295eee194f18" returned: 0 in 0.817s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:50:36 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c34e1a78-4055-4136-986e-5f9f098b57d0 tempest-ServerRescueNegativeTestJSON-70291222 None] Lock "cinder-quobyte-a879e8e5-ecb7-470c-8f72-295eee194f18" released by "delete_volume" :: held 1.970s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:50:36 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-c34e1a78-4055-4136-986e-5f9f098b57d0 tempest-ServerRescueNegativeTestJSON-70291222 None] Created reservations ['b356a7e2-5fa6-4635-aaad-a7c17a4cfa24', '93c2dfae-922e-49c1-8647-70804669a859', 'a47d7b72-ec7f-4812-a1c9-4c3467ef93c5', '25153eca-089d-4309-99cf-3503cf489e00'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:50:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c34e1a78-4055-4136-986e-5f9f098b57d0 tempest-ServerRescueNegativeTestJSON-70291222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:50:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c34e1a78-4055-4136-986e-5f9f098b57d0 tempest-ServerRescueNegativeTestJSON-70291222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:50:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c34e1a78-4055-4136-986e-5f9f098b57d0 tempest-ServerRescueNegativeTestJSON-70291222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:50:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c34e1a78-4055-4136-986e-5f9f098b57d0 tempest-ServerRescueNegativeTestJSON-70291222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:50:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c34e1a78-4055-4136-986e-5f9f098b57d0 tempest-ServerRescueNegativeTestJSON-70291222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:50:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c34e1a78-4055-4136-986e-5f9f098b57d0 tempest-ServerRescueNegativeTestJSON-70291222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:50:36 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:50:36 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:50:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 11:50:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:50:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:50:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:50:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:50:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:50:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:50:36 devstack sudo[88834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:50:36 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:50:37 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root Jun 03 11:50:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.154s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:50:37 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:50:38 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Jun 03 11:50:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c34e1a78-4055-4136-986e-5f9f098b57d0 tempest-ServerRescueNegativeTestJSON-70291222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.478s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:50:38 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-c34e1a78-4055-4136-986e-5f9f098b57d0 tempest-ServerRescueNegativeTestJSON-70291222 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:50:38 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c34e1a78-4055-4136-986e-5f9f098b57d0 tempest-ServerRescueNegativeTestJSON-70291222 None] Deleted volume successfully. Jun 03 11:50:38 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c34e1a78-4055-4136-986e-5f9f098b57d0 tempest-ServerRescueNegativeTestJSON-70291222 None] Lock "cinder-a879e8e5-ecb7-470c-8f72-295eee194f18-delete_volume" released by "delete_volume" :: held 3.861s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:50:46 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:UPDATE=11,cinder:SELECT=5,cinder:INSERT=2 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:50:48 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Flow 'volume_create_manager' (d3cbe875-a6fc-4358-b44e-c36d651f81ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c450dc1-875e-4a7d-86c8-256cc3f2a019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c450dc1-875e-4a7d-86c8-256cc3f2a019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1339994862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db78a094-2c43-42b0-8894-f018eac29fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fcdbfe46e6b4ef29e5a0dc2971f0cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:51:13Z,use_quota=True,user_id='ad187536feeb4d37938d78786ed2ddbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2740f0-f106-415d-839c-c04e4c66d50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2740f0-f106-415d-839c-c04e4c66d50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71390989-9d92-4343-b542-7176347cd10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71390989-9d92-4343-b542-7176347cd10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db78a094-2c43-42b0-8894-f018eac29fa3', 'volume_name': 'volume-db78a094-2c43-42b0-8894-f018eac29fa3', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2c6b42-fa8c-4b0b-a8bf-9ea3fe6480a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2c6b42-fa8c-4b0b-a8bf-9ea3fe6480a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3782fa77-62cc-4289-9033-b89ec4cd2f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:51:12 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Volume db78a094-2c43-42b0-8894-f018eac29fa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db78a094-2c43-42b0-8894-f018eac29fa3', 'volume_size': 1} Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1339994862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db78a094-2c43-42b0-8894-f018eac29fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fcdbfe46e6b4ef29e5a0dc2971f0cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:51:13Z,use_quota=True,user_id='ad187536feeb4d37938d78786ed2ddbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Creating volume db78a094-2c43-42b0-8894-f018eac29fa3 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:51:12 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:51:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-db78a094-2c43-42b0-8894-f018eac29fa3 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:51:12 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-db78a094-2c43-42b0-8894-f018eac29fa3 1073741824 Jun 03 11:51:12 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:51:13 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Jun 03 11:51:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-db78a094-2c43-42b0-8894-f018eac29fa3 1073741824" returned: 0 in 1.095s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:51:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-db78a094-2c43-42b0-8894-f018eac29fa3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:51:13 devstack sudo[89123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-db78a094-2c43-42b0-8894-f018eac29fa3 Jun 03 11:51:13 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:51:14 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root Jun 03 11:51:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-db78a094-2c43-42b0-8894-f018eac29fa3" returned: 0 in 0.976s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:51:14 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] <== create_volume: return (2141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:51:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.144s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:51:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3782fa77-62cc-4289-9033-b89ec4cd2f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db78a094-2c43-42b0-8894-f018eac29fa3', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:51:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a2f9d2-4927-42c7-bf7e-0cd33178333d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:51:14 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Volume volume-db78a094-2c43-42b0-8894-f018eac29fa3 (db78a094-2c43-42b0-8894-f018eac29fa3): created successfully Jun 03 11:51:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a2f9d2-4927-42c7-bf7e-0cd33178333d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:51:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Flow 'volume_create_manager' (d3cbe875-a6fc-4358-b44e-c36d651f81ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:51:14 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-1ac2d850-8caf-46ee-af9f-a611c2aa7e7f tempest-TaggedAttachmentsTest-1039883434 None] Created volume successfully. Jun 03 11:51:17 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Flow 'volume_create_manager' (93d89aa4-929c-473e-89f5-5ca93935800a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e63de80-17fa-412c-938c-8e2eb7ae1eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e63de80-17fa-412c-938c-8e2eb7ae1eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1815009217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebb20fcf-a798-448a-b04d-facefc9e122a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d81bd698e4b74de8823fe7dce707c7d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:51:18Z,use_quota=True,user_id='b54b3ecf9e51489a8f2b9aa0b293e337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294c0d23-51df-4f95-a602-9e5caef81cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294c0d23-51df-4f95-a602-9e5caef81cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8234ea-60ef-4175-911d-f11303833570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8234ea-60ef-4175-911d-f11303833570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebb20fcf-a798-448a-b04d-facefc9e122a', 'volume_name': 'volume-ebb20fcf-a798-448a-b04d-facefc9e122a', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7e4f1f-ef81-4810-bba7-8fa0da866539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7e4f1f-ef81-4810-bba7-8fa0da866539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e347c622-a4b2-4aa3-a366-7572dd0341c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:51:18 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Volume ebb20fcf-a798-448a-b04d-facefc9e122a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebb20fcf-a798-448a-b04d-facefc9e122a', 'volume_size': 1} Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1815009217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebb20fcf-a798-448a-b04d-facefc9e122a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d81bd698e4b74de8823fe7dce707c7d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:51:18Z,use_quota=True,user_id='b54b3ecf9e51489a8f2b9aa0b293e337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Creating volume ebb20fcf-a798-448a-b04d-facefc9e122a {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:51:18 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ebb20fcf-a798-448a-b04d-facefc9e122a 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:51:18 devstack sudo[89147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ebb20fcf-a798-448a-b04d-facefc9e122a 1073741824 Jun 03 11:51:18 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:51:18 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root Jun 03 11:51:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ebb20fcf-a798-448a-b04d-facefc9e122a 1073741824" returned: 0 in 0.911s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:51:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ebb20fcf-a798-448a-b04d-facefc9e122a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:51:19 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ebb20fcf-a798-448a-b04d-facefc9e122a Jun 03 11:51:19 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:51:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ebb20fcf-a798-448a-b04d-facefc9e122a" returned: 0 in 0.783s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:51:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:51:19 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Jun 03 11:51:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:51:19 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e347c622-a4b2-4aa3-a366-7572dd0341c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebb20fcf-a798-448a-b04d-facefc9e122a', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:51:19 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02cd41df-c87f-4751-8ad9-8d6967a5c3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:51:19 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Volume volume-ebb20fcf-a798-448a-b04d-facefc9e122a (ebb20fcf-a798-448a-b04d-facefc9e122a): created successfully Jun 03 11:51:19 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02cd41df-c87f-4751-8ad9-8d6967a5c3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:51:19 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Flow 'volume_create_manager' (93d89aa4-929c-473e-89f5-5ca93935800a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:51:19 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-4bc45d05-33a3-423a-ab73-cdbd67236929 tempest-AttachVolumeShelveTestJSON-954507161 None] Created volume successfully. Jun 03 11:51:29 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:51:29 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:51:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 11:51:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:51:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:51:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:51:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:51:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:51:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:51:36 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:51:36 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:51:38 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Jun 03 11:51:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.286s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:51:38 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:51:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-ec517e65-0ae1-433b-aeef-ecab98cc3044 req-c68898f6-98c1-4a46-9e75-82393dc2ba75 tempest-AttachVolumeShelveTestJSON-954507161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:51:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-ec517e65-0ae1-433b-aeef-ecab98cc3044 req-c68898f6-98c1-4a46-9e75-82393dc2ba75 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:51:44 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c5ba9b-a614-47e2-ba5e-fa915bf4951a]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:51:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-ec517e65-0ae1-433b-aeef-ecab98cc3044 req-c68898f6-98c1-4a46-9e75-82393dc2ba75 tempest-AttachVolumeShelveTestJSON-954507161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ebb20fcf-a798-448a-b04d-facefc9e122a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:51:44 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ebb20fcf-a798-448a-b04d-facefc9e122a Jun 03 11:51:44 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:51:45 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Jun 03 11:51:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-ec517e65-0ae1-433b-aeef-ecab98cc3044 req-c68898f6-98c1-4a46-9e75-82393dc2ba75 tempest-AttachVolumeShelveTestJSON-954507161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ebb20fcf-a798-448a-b04d-facefc9e122a" returned: 0 in 0.826s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:51:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-ec517e65-0ae1-433b-aeef-ecab98cc3044 req-c68898f6-98c1-4a46-9e75-82393dc2ba75 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.855s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:51:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-ec517e65-0ae1-433b-aeef-ecab98cc3044 req-c68898f6-98c1-4a46-9e75-82393dc2ba75 tempest-AttachVolumeShelveTestJSON-954507161 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-ebb20fcf-a798-448a-b04d-facefc9e122a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04780354-09bd-47d7-9b28-b3f0bd683e95', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 11:51:45 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-ec517e65-0ae1-433b-aeef-ecab98cc3044 req-c68898f6-98c1-4a46-9e75-82393dc2ba75 tempest-AttachVolumeShelveTestJSON-954507161 None] attachment_update completed successfully. Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Flow 'volume_create_manager' (3718e011-d656-4780-a65b-e9e23268e1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d9f2f2-46b6-4d87-9801-bdd203f179c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d9f2f2-46b6-4d87-9801-bdd203f179c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1401278325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29495f3e-7450-44d3-bf23-834e82cef934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61769ef557cc435f988dfc5f4d96a8e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:51:51Z,use_quota=True,user_id='0c05344a1485444e93cd755247be8345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0fee894-d1e8-4fe4-b7a2-ca0bc497b538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0fee894-d1e8-4fe4-b7a2-ca0bc497b538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e452c2b-e30c-42c2-b7b3-cee0335e301e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e452c2b-e30c-42c2-b7b3-cee0335e301e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29495f3e-7450-44d3-bf23-834e82cef934', 'volume_name': 'volume-29495f3e-7450-44d3-bf23-834e82cef934', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5bb966-904c-4262-ad0f-d4bf5a5040ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5bb966-904c-4262-ad0f-d4bf5a5040ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85fdd376-607d-44db-9aac-906dba222ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:51:51 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Volume 29495f3e-7450-44d3-bf23-834e82cef934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29495f3e-7450-44d3-bf23-834e82cef934', 'volume_size': 1} Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1401278325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29495f3e-7450-44d3-bf23-834e82cef934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61769ef557cc435f988dfc5f4d96a8e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:51:51Z,use_quota=True,user_id='0c05344a1485444e93cd755247be8345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Creating volume 29495f3e-7450-44d3-bf23-834e82cef934 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:51:51 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:51:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-29495f3e-7450-44d3-bf23-834e82cef934 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:51:51 devstack sudo[89626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-29495f3e-7450-44d3-bf23-834e82cef934 1073741824 Jun 03 11:51:51 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:51:52 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root Jun 03 11:51:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-29495f3e-7450-44d3-bf23-834e82cef934 1073741824" returned: 0 in 1.432s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:51:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-29495f3e-7450-44d3-bf23-834e82cef934 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:51:52 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-29495f3e-7450-44d3-bf23-834e82cef934 Jun 03 11:51:52 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:51:53 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Jun 03 11:51:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-29495f3e-7450-44d3-bf23-834e82cef934" returned: 0 in 0.700s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:51:53 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] <== create_volume: return (2211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:51:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.215s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:51:53 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85fdd376-607d-44db-9aac-906dba222ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29495f3e-7450-44d3-bf23-834e82cef934', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:51:53 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94488091-be97-4d73-8d8e-7af0f086b272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:51:53 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Volume volume-29495f3e-7450-44d3-bf23-834e82cef934 (29495f3e-7450-44d3-bf23-834e82cef934): created successfully Jun 03 11:51:53 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94488091-be97-4d73-8d8e-7af0f086b272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:51:53 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Flow 'volume_create_manager' (3718e011-d656-4780-a65b-e9e23268e1d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:51:53 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-fd0c2c2e-59ba-464d-ac58-badb8c089eb7 tempest-AttachVolumeTestJSON-1265919166 None] Created volume successfully. Jun 03 11:51:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-a49c1f46-f180-4d59-8d66-539d1b2f04f5 req-a7dea17d-39fb-4a73-b7ec-62165964e336 tempest-AttachVolumeTestJSON-1265919166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:51:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-a49c1f46-f180-4d59-8d66-539d1b2f04f5 req-a7dea17d-39fb-4a73-b7ec-62165964e336 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:51:57 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[027f5497-dc52-492b-9402-0313842d7a1d]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:51:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-a49c1f46-f180-4d59-8d66-539d1b2f04f5 req-a7dea17d-39fb-4a73-b7ec-62165964e336 tempest-AttachVolumeTestJSON-1265919166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-29495f3e-7450-44d3-bf23-834e82cef934 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:51:57 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-29495f3e-7450-44d3-bf23-834e82cef934 Jun 03 11:51:57 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:51:58 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Jun 03 11:51:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-a49c1f46-f180-4d59-8d66-539d1b2f04f5 req-a7dea17d-39fb-4a73-b7ec-62165964e336 tempest-AttachVolumeTestJSON-1265919166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-29495f3e-7450-44d3-bf23-834e82cef934" returned: 0 in 1.030s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:51:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-a49c1f46-f180-4d59-8d66-539d1b2f04f5 req-a7dea17d-39fb-4a73-b7ec-62165964e336 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.048s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:51:58 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-a49c1f46-f180-4d59-8d66-539d1b2f04f5 req-a7dea17d-39fb-4a73-b7ec-62165964e336 tempest-AttachVolumeTestJSON-1265919166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-29495f3e-7450-44d3-bf23-834e82cef934', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37d862cd-507d-47ca-931c-37a2a2d54e9a', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 11:51:58 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-a49c1f46-f180-4d59-8d66-539d1b2f04f5 req-a7dea17d-39fb-4a73-b7ec-62165964e336 tempest-AttachVolumeTestJSON-1265919166 None] attachment_update completed successfully. Jun 03 11:52:08 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=15,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:52:08 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Flow 'volume_create_manager' (156f0e3f-9713-43f1-84d6-025f27f2df32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68ccaf4-de61-43d4-a9d7-7ee40694cd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68ccaf4-de61-43d4-a9d7-7ee40694cd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1415389191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6de29b8bd84b30aa342263448fc61b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:52:12Z,use_quota=True,user_id='0a6a18593a884177b948787d36a36211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe5b0955-f021-4afb-a8db-0342e3ec4235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe5b0955-f021-4afb-a8db-0342e3ec4235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b350f7-2acd-4d91-9f08-758bbe16b1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b350f7-2acd-4d91-9f08-758bbe16b1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7', 'volume_name': 'volume-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa7882a-bee5-431b-9746-46c452ae8fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa7882a-bee5-431b-9746-46c452ae8fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecea4082-5b4f-4ccd-af81-0c53c610dc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:52:12 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Volume 19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7', 'volume_size': 1} Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1415389191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6de29b8bd84b30aa342263448fc61b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:52:12Z,use_quota=True,user_id='0a6a18593a884177b948787d36a36211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Creating volume 19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:52:12 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:52:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:52:12 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7 1073741824 Jun 03 11:52:12 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:52:13 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Jun 03 11:52:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7 1073741824" returned: 0 in 0.868s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:52:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:52:13 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7 Jun 03 11:52:13 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:52:13 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Jun 03 11:52:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7" returned: 0 in 0.747s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:52:13 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:52:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:52:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecea4082-5b4f-4ccd-af81-0c53c610dc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:52:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (470b816c-e524-4576-8543-6a5aa15fd704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:52:13 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Volume volume-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7 (19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7): created successfully Jun 03 11:52:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (470b816c-e524-4576-8543-6a5aa15fd704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:52:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Flow 'volume_create_manager' (156f0e3f-9713-43f1-84d6-025f27f2df32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:52:13 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-6fd0c975-893d-4c3a-977f-7afcf3f5e7be tempest-AttachVolumeNegativeTest-954122186 None] Created volume successfully. Jun 03 11:52:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-d2a0d8b2-a7d1-4ea8-b768-89d11489b3d2 req-683b6dc6-4610-4bfe-b20e-3dcfa5352924 tempest-TaggedAttachmentsTest-1039883434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:52:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-d2a0d8b2-a7d1-4ea8-b768-89d11489b3d2 req-683b6dc6-4610-4bfe-b20e-3dcfa5352924 tempest-TaggedAttachmentsTest-1039883434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:52:16 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d17ff9-f554-4737-93e7-94b6017134d2]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:52:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-d2a0d8b2-a7d1-4ea8-b768-89d11489b3d2 req-683b6dc6-4610-4bfe-b20e-3dcfa5352924 tempest-TaggedAttachmentsTest-1039883434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-db78a094-2c43-42b0-8894-f018eac29fa3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:52:16 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-db78a094-2c43-42b0-8894-f018eac29fa3 Jun 03 11:52:16 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:52:17 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Jun 03 11:52:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-d2a0d8b2-a7d1-4ea8-b768-89d11489b3d2 req-683b6dc6-4610-4bfe-b20e-3dcfa5352924 tempest-TaggedAttachmentsTest-1039883434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-db78a094-2c43-42b0-8894-f018eac29fa3" returned: 0 in 0.788s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:52:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-d2a0d8b2-a7d1-4ea8-b768-89d11489b3d2 req-683b6dc6-4610-4bfe-b20e-3dcfa5352924 tempest-TaggedAttachmentsTest-1039883434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.817s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:52:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-d2a0d8b2-a7d1-4ea8-b768-89d11489b3d2 req-683b6dc6-4610-4bfe-b20e-3dcfa5352924 tempest-TaggedAttachmentsTest-1039883434 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-db78a094-2c43-42b0-8894-f018eac29fa3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd6fcfc1-f394-4264-8842-f68a94463d6d', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 11:52:17 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-d2a0d8b2-a7d1-4ea8-b768-89d11489b3d2 req-683b6dc6-4610-4bfe-b20e-3dcfa5352924 tempest-TaggedAttachmentsTest-1039883434 None] attachment_update completed successfully. Jun 03 11:52:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-99159606-9b40-4fff-bf67-dce749619a10 req-f56ce222-6c37-4532-8f45-dc6f9a79a425 tempest-AttachVolumeNegativeTest-954122186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:52:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-99159606-9b40-4fff-bf67-dce749619a10 req-f56ce222-6c37-4532-8f45-dc6f9a79a425 tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:52:17 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f3def2-4301-42b5-a2c4-5ca482616739]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:52:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-99159606-9b40-4fff-bf67-dce749619a10 req-f56ce222-6c37-4532-8f45-dc6f9a79a425 tempest-AttachVolumeNegativeTest-954122186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:52:17 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7 Jun 03 11:52:17 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:52:19 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Jun 03 11:52:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-99159606-9b40-4fff-bf67-dce749619a10 req-f56ce222-6c37-4532-8f45-dc6f9a79a425 tempest-AttachVolumeNegativeTest-954122186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7" returned: 0 in 1.396s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:52:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-99159606-9b40-4fff-bf67-dce749619a10 req-f56ce222-6c37-4532-8f45-dc6f9a79a425 tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.483s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:52:19 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-99159606-9b40-4fff-bf67-dce749619a10 req-f56ce222-6c37-4532-8f45-dc6f9a79a425 tempest-AttachVolumeNegativeTest-954122186 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5820e60c-ac4a-4d19-b328-9db2fe85be13', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 11:52:19 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-99159606-9b40-4fff-bf67-dce749619a10 req-f56ce222-6c37-4532-8f45-dc6f9a79a425 tempest-AttachVolumeNegativeTest-954122186 None] attachment_update completed successfully. Jun 03 11:52:23 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-f284314c-260c-492f-a4e0-8975e592b72c req-778a2b66-57dc-44ad-a7ee-808ea7c35fcc tempest-TaggedAttachmentsTest-1039883434 None] Terminate volume connection completed successfully. Jun 03 11:52:23 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-f284314c-260c-492f-a4e0-8975e592b72c req-778a2b66-57dc-44ad-a7ee-808ea7c35fcc tempest-TaggedAttachmentsTest-1039883434 None] Deleting attachment cd6fcfc1-f394-4264-8842-f68a94463d6d. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 11:52:29 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-e22f3406-a07c-48fe-af80-38d0b358bb88 req-6c64c9f6-d1e7-4f09-b0b6-b2979e9ade6a tempest-AttachVolumeShelveTestJSON-954507161 None] Terminate volume connection completed successfully. Jun 03 11:52:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-e22f3406-a07c-48fe-af80-38d0b358bb88 req-6c64c9f6-d1e7-4f09-b0b6-b2979e9ade6a tempest-AttachVolumeShelveTestJSON-954507161 None] Deleting attachment 04780354-09bd-47d7-9b28-b3f0bd683e95. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 11:52:33 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:UPDATE=9,cinder:SELECT=13,cinder:INSERT=1 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:52:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 11:52:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:52:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:52:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:52:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:52:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:52:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:52:36 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:52:36 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:52:37 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Jun 03 11:52:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.758s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:52:37 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:52:39 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=18,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:52:44 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-80410b85-681b-4800-b6e0-9af0e2b4d69d tempest-TaggedAttachmentsTest-1039883434 None] Acquiring lock "cinder-db78a094-2c43-42b0-8894-f018eac29fa3-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:52:44 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-80410b85-681b-4800-b6e0-9af0e2b4d69d tempest-TaggedAttachmentsTest-1039883434 None] Lock "cinder-db78a094-2c43-42b0-8894-f018eac29fa3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:52:44 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-80410b85-681b-4800-b6e0-9af0e2b4d69d tempest-TaggedAttachmentsTest-1039883434 None] Acquiring lock "cinder-quobyte-db78a094-2c43-42b0-8894-f018eac29fa3" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:52:44 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-80410b85-681b-4800-b6e0-9af0e2b4d69d tempest-TaggedAttachmentsTest-1039883434 None] Lock "cinder-quobyte-db78a094-2c43-42b0-8894-f018eac29fa3" acquired by "delete_volume" :: waited 0.017s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:52:44 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bc7f58-caea-4f22-8bc6-a7365ef8d439]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:52:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-80410b85-681b-4800-b6e0-9af0e2b4d69d tempest-TaggedAttachmentsTest-1039883434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-db78a094-2c43-42b0-8894-f018eac29fa3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:52:44 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-db78a094-2c43-42b0-8894-f018eac29fa3 Jun 03 11:52:44 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:52:45 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Jun 03 11:52:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-80410b85-681b-4800-b6e0-9af0e2b4d69d tempest-TaggedAttachmentsTest-1039883434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-db78a094-2c43-42b0-8894-f018eac29fa3" returned: 0 in 0.856s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:52:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-80410b85-681b-4800-b6e0-9af0e2b4d69d tempest-TaggedAttachmentsTest-1039883434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-db78a094-2c43-42b0-8894-f018eac29fa3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:52:45 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-db78a094-2c43-42b0-8894-f018eac29fa3 Jun 03 11:52:45 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:52:45 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-32833df3-8ac5-42e0-86d5-20b461d955b6 req-76405c09-0c47-4e0b-8947-69afb528d7de tempest-AttachVolumeTestJSON-1265919166 None] Terminate volume connection completed successfully. Jun 03 11:52:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-32833df3-8ac5-42e0-86d5-20b461d955b6 req-76405c09-0c47-4e0b-8947-69afb528d7de tempest-AttachVolumeTestJSON-1265919166 None] Deleting attachment 37d862cd-507d-47ca-931c-37a2a2d54e9a. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 11:52:46 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Jun 03 11:52:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-80410b85-681b-4800-b6e0-9af0e2b4d69d tempest-TaggedAttachmentsTest-1039883434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-db78a094-2c43-42b0-8894-f018eac29fa3" returned: 0 in 0.969s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:52:46 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-80410b85-681b-4800-b6e0-9af0e2b4d69d tempest-TaggedAttachmentsTest-1039883434 None] Lock "cinder-quobyte-db78a094-2c43-42b0-8894-f018eac29fa3" released by "delete_volume" :: held 1.889s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:52:46 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-80410b85-681b-4800-b6e0-9af0e2b4d69d tempest-TaggedAttachmentsTest-1039883434 None] Created reservations ['5aca93dc-9761-4bf7-9d09-a4b71a800dcd', '3f5b200f-6974-454e-b05e-ca897c219f80', '355fcd38-7e18-41a2-af64-842238e87190', 'c64a34a8-281d-40c6-a3d6-f0bb82ea1b61'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:52:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-80410b85-681b-4800-b6e0-9af0e2b4d69d tempest-TaggedAttachmentsTest-1039883434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:52:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-80410b85-681b-4800-b6e0-9af0e2b4d69d tempest-TaggedAttachmentsTest-1039883434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:52:46 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-80410b85-681b-4800-b6e0-9af0e2b4d69d tempest-TaggedAttachmentsTest-1039883434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:52:46 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-80410b85-681b-4800-b6e0-9af0e2b4d69d tempest-TaggedAttachmentsTest-1039883434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:52:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-80410b85-681b-4800-b6e0-9af0e2b4d69d tempest-TaggedAttachmentsTest-1039883434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:52:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-80410b85-681b-4800-b6e0-9af0e2b4d69d tempest-TaggedAttachmentsTest-1039883434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:52:46 devstack sudo[90747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:52:46 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:52:47 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root Jun 03 11:52:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-80410b85-681b-4800-b6e0-9af0e2b4d69d tempest-TaggedAttachmentsTest-1039883434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.211s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:52:47 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-80410b85-681b-4800-b6e0-9af0e2b4d69d tempest-TaggedAttachmentsTest-1039883434 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:52:47 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-80410b85-681b-4800-b6e0-9af0e2b4d69d tempest-TaggedAttachmentsTest-1039883434 None] Deleted volume successfully. Jun 03 11:52:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-80410b85-681b-4800-b6e0-9af0e2b4d69d tempest-TaggedAttachmentsTest-1039883434 None] Lock "cinder-db78a094-2c43-42b0-8894-f018eac29fa3-delete_volume" released by "delete_volume" :: held 3.431s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:52:56 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=8,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:52:57 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:53:21 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-e3d8d848-1be0-4b10-8675-1062dcd2800b req-943a4faa-ca24-4a9d-b55d-0eaa719125ac tempest-AttachVolumeNegativeTest-954122186 None] Terminate volume connection completed successfully. Jun 03 11:53:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-e3d8d848-1be0-4b10-8675-1062dcd2800b req-943a4faa-ca24-4a9d-b55d-0eaa719125ac tempest-AttachVolumeNegativeTest-954122186 None] Deleting attachment 5820e60c-ac4a-4d19-b328-9db2fe85be13. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Flow 'volume_create_manager' (32bf92cf-d2d2-4e74-8ec1-8c780642e5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28c9e76-939b-477c-825c-67f01c7b5873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28c9e76-939b-477c-825c-67f01c7b5873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-206235436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41ea5af-5665-41b6-9fca-dbb060ce9011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d81bd698e4b74de8823fe7dce707c7d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:53:28Z,use_quota=True,user_id='b54b3ecf9e51489a8f2b9aa0b293e337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f158f28-c08c-44d7-bda5-29c9371270a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f158f28-c08c-44d7-bda5-29c9371270a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06cda6bc-c0ab-44ec-9cd7-cf4e3244d926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06cda6bc-c0ab-44ec-9cd7-cf4e3244d926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c41ea5af-5665-41b6-9fca-dbb060ce9011', 'volume_name': 'volume-c41ea5af-5665-41b6-9fca-dbb060ce9011', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6d95f2-7ba5-4588-be6b-966ad0558c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6d95f2-7ba5-4588-be6b-966ad0558c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ae95b1-f59a-4231-8b19-89832589a99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:53:27 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Volume c41ea5af-5665-41b6-9fca-dbb060ce9011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c41ea5af-5665-41b6-9fca-dbb060ce9011', 'volume_size': 1} Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-206235436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41ea5af-5665-41b6-9fca-dbb060ce9011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d81bd698e4b74de8823fe7dce707c7d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:53:28Z,use_quota=True,user_id='b54b3ecf9e51489a8f2b9aa0b293e337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Creating volume c41ea5af-5665-41b6-9fca-dbb060ce9011 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:53:27 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:53:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c41ea5af-5665-41b6-9fca-dbb060ce9011 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:53:27 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c41ea5af-5665-41b6-9fca-dbb060ce9011 1073741824 Jun 03 11:53:27 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:53:28 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Jun 03 11:53:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c41ea5af-5665-41b6-9fca-dbb060ce9011 1073741824" returned: 0 in 0.816s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:53:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c41ea5af-5665-41b6-9fca-dbb060ce9011 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:53:28 devstack sudo[91217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c41ea5af-5665-41b6-9fca-dbb060ce9011 Jun 03 11:53:28 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:53:29 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root Jun 03 11:53:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c41ea5af-5665-41b6-9fca-dbb060ce9011" returned: 0 in 0.638s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:53:29 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:53:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:53:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ae95b1-f59a-4231-8b19-89832589a99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c41ea5af-5665-41b6-9fca-dbb060ce9011', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:53:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abfa4cd5-4c9b-405b-8bfe-3e62af28dc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:53:29 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Volume volume-c41ea5af-5665-41b6-9fca-dbb060ce9011 (c41ea5af-5665-41b6-9fca-dbb060ce9011): created successfully Jun 03 11:53:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abfa4cd5-4c9b-405b-8bfe-3e62af28dc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:53:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Flow 'volume_create_manager' (32bf92cf-d2d2-4e74-8ec1-8c780642e5ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:53:29 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c3e5acd1-6468-44c9-a796-21e261613859 tempest-AttachVolumeShelveTestJSON-954507161 None] Created volume successfully. Jun 03 11:53:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 11:53:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:53:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:53:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:53:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:53:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:53:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:53:36 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:53:36 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:53:37 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Jun 03 11:53:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.066s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:53:37 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:53:39 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:53:39 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:53:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-b35092e5-3d08-4f12-aa4d-acd3cc7cdde2 req-6c8d095f-970b-4766-a664-6fe3b03a3e6c tempest-AttachVolumeShelveTestJSON-954507161 None] No connector for attachment 9f324571-ffff-44dd-80b8-ed5d47a0307b; skipping storage backend terminate_connection call. {{(pid=86724) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 03 11:53:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-b35092e5-3d08-4f12-aa4d-acd3cc7cdde2 req-6c8d095f-970b-4766-a664-6fe3b03a3e6c tempest-AttachVolumeShelveTestJSON-954507161 None] Deleting attachment 9f324571-ffff-44dd-80b8-ed5d47a0307b. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 11:53:57 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=2 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:53:59 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:54:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Flow 'volume_create_manager' (4ea9f6bc-1816-4bfb-9cdc-2f298fdd2d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:54:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898f721b-6c13-46ab-97c4-5cfd4e68d00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898f721b-6c13-46ab-97c4-5cfd4e68d00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1747373418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d942fd-0348-4fe8-bc4d-c57409689093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4fec1fbc19d4cc08a1608b2c44ee527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:54:00Z,use_quota=True,user_id='85b7d5cbf9724219be61911565ff98d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2dfd67-a0a8-4240-8c51-146a0bc2ff39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2dfd67-a0a8-4240-8c51-146a0bc2ff39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080060f4-953f-49e8-a559-d2389ecdc208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080060f4-953f-49e8-a559-d2389ecdc208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4d942fd-0348-4fe8-bc4d-c57409689093', 'volume_name': 'volume-d4d942fd-0348-4fe8-bc4d-c57409689093', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8957eb-7cd5-4024-bbd8-07a8120a6e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8957eb-7cd5-4024-bbd8-07a8120a6e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d7b78c-df40-4c46-b0cc-8da20e8bc303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:00 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Volume d4d942fd-0348-4fe8-bc4d-c57409689093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4d942fd-0348-4fe8-bc4d-c57409689093', 'volume_size': 1} Jun 03 11:54:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:54:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:54:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1747373418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d942fd-0348-4fe8-bc4d-c57409689093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4fec1fbc19d4cc08a1608b2c44ee527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:54:00Z,use_quota=True,user_id='85b7d5cbf9724219be61911565ff98d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:54:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Creating volume d4d942fd-0348-4fe8-bc4d-c57409689093 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:54:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:54:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:54:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:54:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:54:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:54:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:54:00 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:54:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4d942fd-0348-4fe8-bc4d-c57409689093 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:54:00 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4d942fd-0348-4fe8-bc4d-c57409689093 1073741824 Jun 03 11:54:00 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:54:02 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Jun 03 11:54:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4d942fd-0348-4fe8-bc4d-c57409689093 1073741824" returned: 0 in 2.004s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:54:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4d942fd-0348-4fe8-bc4d-c57409689093 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:54:02 devstack sudo[91627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4d942fd-0348-4fe8-bc4d-c57409689093 Jun 03 11:54:02 devstack sudo[91627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:54:03 devstack sudo[91627]: pam_unix(sudo:session): session closed for user root Jun 03 11:54:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4d942fd-0348-4fe8-bc4d-c57409689093" returned: 0 in 1.071s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:54:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] <== create_volume: return (3153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:54:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.157s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:54:03 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d7b78c-df40-4c46-b0cc-8da20e8bc303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4d942fd-0348-4fe8-bc4d-c57409689093', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:03 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7160198c-0226-4824-82cb-fd2777cab699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:03 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Volume volume-d4d942fd-0348-4fe8-bc4d-c57409689093 (d4d942fd-0348-4fe8-bc4d-c57409689093): created successfully Jun 03 11:54:03 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7160198c-0226-4824-82cb-fd2777cab699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:03 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Flow 'volume_create_manager' (4ea9f6bc-1816-4bfb-9cdc-2f298fdd2d35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:54:03 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-dcc9d045-1b08-43eb-b9f8-c8ea31e4ac80 tempest-ServerActionsTestOtherA-128600654 None] Created volume successfully. Jun 03 11:54:13 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:54:13 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:54:14 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:54:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Flow 'volume_create_manager' (37bb91a4-5c12-408f-bcb2-e1b22a65d8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:54:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caedb527-0879-4717-9a51-ba7e4ef9d481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caedb527-0879-4717-9a51-ba7e4ef9d481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-462729920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6de29b8bd84b30aa342263448fc61b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:54:15Z,use_quota=True,user_id='0a6a18593a884177b948787d36a36211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf45992-9c9d-45e4-8ced-d3151544df33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf45992-9c9d-45e4-8ced-d3151544df33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e68de6-480b-4cec-bdbd-8a50f4584b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e68de6-480b-4cec-bdbd-8a50f4584b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd', 'volume_name': 'volume-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13ba150-7e7f-4952-8d74-8d885687ec38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13ba150-7e7f-4952-8d74-8d885687ec38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006313a0-cbeb-4816-ae78-d2bda24b29d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:15 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Volume 9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd', 'volume_size': 1} Jun 03 11:54:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:54:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:54:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-462729920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6de29b8bd84b30aa342263448fc61b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:54:15Z,use_quota=True,user_id='0a6a18593a884177b948787d36a36211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:54:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Creating volume 9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:54:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:54:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:54:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:54:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:54:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:54:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:54:15 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:54:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:54:15 devstack sudo[91844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd 1073741824 Jun 03 11:54:15 devstack sudo[91844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:54:16 devstack sudo[91844]: pam_unix(sudo:session): session closed for user root Jun 03 11:54:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd 1073741824" returned: 0 in 1.219s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:54:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:54:16 devstack sudo[91852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd Jun 03 11:54:16 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:54:17 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root Jun 03 11:54:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd" returned: 0 in 0.772s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:54:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] <== create_volume: return (2047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:54:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.050s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:54:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006313a0-cbeb-4816-ae78-d2bda24b29d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05559b4-4bad-480d-8877-e4cc9039ac2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:17 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Volume volume-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd (9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd): created successfully Jun 03 11:54:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05559b4-4bad-480d-8877-e4cc9039ac2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Flow 'volume_create_manager' (37bb91a4-5c12-408f-bcb2-e1b22a65d8bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:54:17 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-41da6392-819e-4735-8e69-af92333285da tempest-AttachVolumeNegativeTest-954122186 None] Created volume successfully. Jun 03 11:54:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-7e92e12b-d3a3-41b0-b817-d310856309e3 req-8b53b608-395e-4c7f-9ec3-89d27c4a130a tempest-AttachVolumeNegativeTest-954122186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:54:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-7e92e12b-d3a3-41b0-b817-d310856309e3 req-8b53b608-395e-4c7f-9ec3-89d27c4a130a tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:54:21 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d8bbb9-3578-4fc1-a8da-32e89ee9729a]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:54:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-7e92e12b-d3a3-41b0-b817-d310856309e3 req-8b53b608-395e-4c7f-9ec3-89d27c4a130a tempest-AttachVolumeNegativeTest-954122186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:54:22 devstack sudo[91935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd Jun 03 11:54:22 devstack sudo[91935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:54:22 devstack sudo[91935]: pam_unix(sudo:session): session closed for user root Jun 03 11:54:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-7e92e12b-d3a3-41b0-b817-d310856309e3 req-8b53b608-395e-4c7f-9ec3-89d27c4a130a tempest-AttachVolumeNegativeTest-954122186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd" returned: 0 in 1.075s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:54:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-7e92e12b-d3a3-41b0-b817-d310856309e3 req-8b53b608-395e-4c7f-9ec3-89d27c4a130a tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.126s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:54:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-7e92e12b-d3a3-41b0-b817-d310856309e3 req-8b53b608-395e-4c7f-9ec3-89d27c4a130a tempest-AttachVolumeNegativeTest-954122186 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37542aae-e266-4b24-99e8-a55fc57a391b', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 11:54:23 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-7e92e12b-d3a3-41b0-b817-d310856309e3 req-8b53b608-395e-4c7f-9ec3-89d27c4a130a tempest-AttachVolumeNegativeTest-954122186 None] attachment_update completed successfully. Jun 03 11:54:29 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-708eb10b-a1c6-4444-abca-cf6710169e30 req-ce50f3be-0d3c-4f24-a993-08fa24b4b7b1 tempest-AttachVolumeNegativeTest-954122186 None] Terminate volume connection completed successfully. Jun 03 11:54:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-708eb10b-a1c6-4444-abca-cf6710169e30 req-ce50f3be-0d3c-4f24-a993-08fa24b4b7b1 tempest-AttachVolumeNegativeTest-954122186 None] Deleting attachment 37542aae-e266-4b24-99e8-a55fc57a391b. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 11:54:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 11:54:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:54:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:54:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:54:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:54:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:54:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:54:36 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:54:36 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:54:37 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Jun 03 11:54:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.741s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:54:37 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Flow 'volume_create_manager' (8e3f94c2-3b43-445b-8810-da9e2addcb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0877b87-cebd-4a39-9ab2-268bf30678d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0877b87-cebd-4a39-9ab2-268bf30678d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-456495442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0454b651-6718-4d7c-ac8c-df2066d33c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61769ef557cc435f988dfc5f4d96a8e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:54:39Z,use_quota=True,user_id='0c05344a1485444e93cd755247be8345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5e96f8-e4aa-4046-80ff-1a485be004a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5e96f8-e4aa-4046-80ff-1a485be004a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c013f74-5682-421a-a0ec-22cfa9679d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c013f74-5682-421a-a0ec-22cfa9679d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0454b651-6718-4d7c-ac8c-df2066d33c5d', 'volume_name': 'volume-0454b651-6718-4d7c-ac8c-df2066d33c5d', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c39f839-fbc2-44c9-b945-7ff8539307f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c39f839-fbc2-44c9-b945-7ff8539307f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdccf7f8-0d78-4afe-b03a-7ea1c5ba6076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:38 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Volume 0454b651-6718-4d7c-ac8c-df2066d33c5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0454b651-6718-4d7c-ac8c-df2066d33c5d', 'volume_size': 1} Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-456495442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0454b651-6718-4d7c-ac8c-df2066d33c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61769ef557cc435f988dfc5f4d96a8e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:54:39Z,use_quota=True,user_id='0c05344a1485444e93cd755247be8345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Creating volume 0454b651-6718-4d7c-ac8c-df2066d33c5d {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:54:38 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:54:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0454b651-6718-4d7c-ac8c-df2066d33c5d 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:54:38 devstack sudo[92492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0454b651-6718-4d7c-ac8c-df2066d33c5d 1073741824 Jun 03 11:54:38 devstack sudo[92492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:54:39 devstack sudo[92492]: pam_unix(sudo:session): session closed for user root Jun 03 11:54:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0454b651-6718-4d7c-ac8c-df2066d33c5d 1073741824" returned: 0 in 0.758s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:54:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0454b651-6718-4d7c-ac8c-df2066d33c5d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:54:39 devstack sudo[92497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0454b651-6718-4d7c-ac8c-df2066d33c5d Jun 03 11:54:39 devstack sudo[92497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:54:40 devstack sudo[92497]: pam_unix(sudo:session): session closed for user root Jun 03 11:54:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0454b651-6718-4d7c-ac8c-df2066d33c5d" returned: 0 in 0.655s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:54:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:54:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:54:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdccf7f8-0d78-4afe-b03a-7ea1c5ba6076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0454b651-6718-4d7c-ac8c-df2066d33c5d', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa1a9ad-cc20-4232-a13a-4f1ef9d0c56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:40 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Volume volume-0454b651-6718-4d7c-ac8c-df2066d33c5d (0454b651-6718-4d7c-ac8c-df2066d33c5d): created successfully Jun 03 11:54:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa1a9ad-cc20-4232-a13a-4f1ef9d0c56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Flow 'volume_create_manager' (8e3f94c2-3b43-445b-8810-da9e2addcb79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:54:40 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-15e0c272-6ecc-4a7a-8d7e-21ac5880b784 tempest-AttachVolumeTestJSON-1265919166 None] Created volume successfully. Jun 03 11:54:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-a12d80c7-8b16-416d-8442-034f5f37db47 req-5d9c785c-7664-4807-9c5f-e0020fafb921 tempest-AttachVolumeTestJSON-1265919166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:54:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-a12d80c7-8b16-416d-8442-034f5f37db47 req-5d9c785c-7664-4807-9c5f-e0020fafb921 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:54:43 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9e9dcc-ca1d-4ddc-9043-e7d1fcaa5f32]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:54:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-a12d80c7-8b16-416d-8442-034f5f37db47 req-5d9c785c-7664-4807-9c5f-e0020fafb921 tempest-AttachVolumeTestJSON-1265919166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0454b651-6718-4d7c-ac8c-df2066d33c5d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:54:43 devstack sudo[92519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0454b651-6718-4d7c-ac8c-df2066d33c5d Jun 03 11:54:43 devstack sudo[92519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:54:44 devstack sudo[92519]: pam_unix(sudo:session): session closed for user root Jun 03 11:54:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-a12d80c7-8b16-416d-8442-034f5f37db47 req-5d9c785c-7664-4807-9c5f-e0020fafb921 tempest-AttachVolumeTestJSON-1265919166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0454b651-6718-4d7c-ac8c-df2066d33c5d" returned: 0 in 0.759s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:54:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-a12d80c7-8b16-416d-8442-034f5f37db47 req-5d9c785c-7664-4807-9c5f-e0020fafb921 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.784s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:54:44 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-a12d80c7-8b16-416d-8442-034f5f37db47 req-5d9c785c-7664-4807-9c5f-e0020fafb921 tempest-AttachVolumeTestJSON-1265919166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-0454b651-6718-4d7c-ac8c-df2066d33c5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd21c2c89-e843-412d-8f4a-180b9ef350dd', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 11:54:44 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-a12d80c7-8b16-416d-8442-034f5f37db47 req-5d9c785c-7664-4807-9c5f-e0020fafb921 tempest-AttachVolumeTestJSON-1265919166 None] attachment_update completed successfully. Jun 03 11:54:49 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:54:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Flow 'volume_create_manager' (aa880617-27a3-4392-826b-f1caaf7c1028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:54:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa7fa12-a23b-45ac-8ac6-1b0595dd6a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa7fa12-a23b-45ac-8ac6-1b0595dd6a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-27228917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75dda57-bf28-421e-83bc-59833834a5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61769ef557cc435f988dfc5f4d96a8e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:54:50Z,use_quota=True,user_id='0c05344a1485444e93cd755247be8345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d662d5-8a8f-4c7c-89ee-c1a7d7c27b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d662d5-8a8f-4c7c-89ee-c1a7d7c27b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337f7e70-8de5-4318-a31b-75ca3a62c526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337f7e70-8de5-4318-a31b-75ca3a62c526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e75dda57-bf28-421e-83bc-59833834a5e2', 'volume_name': 'volume-e75dda57-bf28-421e-83bc-59833834a5e2', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c72a79-6e4e-433f-86c0-1bc137b1c604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c72a79-6e4e-433f-86c0-1bc137b1c604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df93e31-62f6-4789-83ab-90815e062f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:49 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Volume e75dda57-bf28-421e-83bc-59833834a5e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e75dda57-bf28-421e-83bc-59833834a5e2', 'volume_size': 1} Jun 03 11:54:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:54:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:54:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-27228917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75dda57-bf28-421e-83bc-59833834a5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61769ef557cc435f988dfc5f4d96a8e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:54:50Z,use_quota=True,user_id='0c05344a1485444e93cd755247be8345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:54:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Creating volume e75dda57-bf28-421e-83bc-59833834a5e2 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:54:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:54:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:54:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:54:50 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:54:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:54:50 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:54:50 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:54:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e75dda57-bf28-421e-83bc-59833834a5e2 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:54:50 devstack sudo[92957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e75dda57-bf28-421e-83bc-59833834a5e2 1073741824 Jun 03 11:54:50 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:54:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-6f879817-2e40-4f8f-a966-e0cde7551667 req-50831850-0b18-4aa7-8d83-9095fa8ea654 tempest-ServerActionsTestOtherA-128600654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:54:51 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root Jun 03 11:54:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e75dda57-bf28-421e-83bc-59833834a5e2 1073741824" returned: 0 in 1.156s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:54:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e75dda57-bf28-421e-83bc-59833834a5e2 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:54:51 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e75dda57-bf28-421e-83bc-59833834a5e2 Jun 03 11:54:51 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:54:51 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Jun 03 11:54:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e75dda57-bf28-421e-83bc-59833834a5e2" returned: 0 in 0.701s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:54:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:54:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:54:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-6f879817-2e40-4f8f-a966-e0cde7551667 req-50831850-0b18-4aa7-8d83-9095fa8ea654 tempest-ServerActionsTestOtherA-128600654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.263s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:54:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df93e31-62f6-4789-83ab-90815e062f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e75dda57-bf28-421e-83bc-59833834a5e2', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb92142e-ff95-4d3d-9cdb-f23d21d16dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:54:51 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[23132211-4325-432f-8598-ee4689401b15]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:54:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-6f879817-2e40-4f8f-a966-e0cde7551667 req-50831850-0b18-4aa7-8d83-9095fa8ea654 tempest-ServerActionsTestOtherA-128600654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4d942fd-0348-4fe8-bc4d-c57409689093 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:54:51 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Volume volume-e75dda57-bf28-421e-83bc-59833834a5e2 (e75dda57-bf28-421e-83bc-59833834a5e2): created successfully Jun 03 11:54:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb92142e-ff95-4d3d-9cdb-f23d21d16dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:54:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Flow 'volume_create_manager' (aa880617-27a3-4392-826b-f1caaf7c1028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:54:51 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-cf9a51b4-0fa3-4538-905f-a359d86df499 tempest-AttachVolumeTestJSON-1265919166 None] Created volume successfully. Jun 03 11:54:52 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4d942fd-0348-4fe8-bc4d-c57409689093 Jun 03 11:54:52 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:54:52 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Jun 03 11:54:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-6f879817-2e40-4f8f-a966-e0cde7551667 req-50831850-0b18-4aa7-8d83-9095fa8ea654 tempest-ServerActionsTestOtherA-128600654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4d942fd-0348-4fe8-bc4d-c57409689093" returned: 0 in 0.928s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:54:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-6f879817-2e40-4f8f-a966-e0cde7551667 req-50831850-0b18-4aa7-8d83-9095fa8ea654 tempest-ServerActionsTestOtherA-128600654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.957s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:54:52 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-6f879817-2e40-4f8f-a966-e0cde7551667 req-50831850-0b18-4aa7-8d83-9095fa8ea654 tempest-ServerActionsTestOtherA-128600654 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-d4d942fd-0348-4fe8-bc4d-c57409689093', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '699d0a0c-c17f-420c-a9fe-53198c92204e', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 11:54:52 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-6f879817-2e40-4f8f-a966-e0cde7551667 req-50831850-0b18-4aa7-8d83-9095fa8ea654 tempest-ServerActionsTestOtherA-128600654 None] attachment_update completed successfully. Jun 03 11:54:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-43521a68-70d3-4b8f-ba9a-6e1052ffa251 req-c5f32eac-e766-4f01-9766-4eb5ab1a1ee1 tempest-AttachVolumeTestJSON-1265919166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:54:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-43521a68-70d3-4b8f-ba9a-6e1052ffa251 req-c5f32eac-e766-4f01-9766-4eb5ab1a1ee1 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:54:56 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac320ff5-1513-44b0-912e-1f30c26c48d1]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:54:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-43521a68-70d3-4b8f-ba9a-6e1052ffa251 req-c5f32eac-e766-4f01-9766-4eb5ab1a1ee1 tempest-AttachVolumeTestJSON-1265919166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e75dda57-bf28-421e-83bc-59833834a5e2 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:54:57 devstack sudo[93123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e75dda57-bf28-421e-83bc-59833834a5e2 Jun 03 11:54:57 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:54:57 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root Jun 03 11:54:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-43521a68-70d3-4b8f-ba9a-6e1052ffa251 req-c5f32eac-e766-4f01-9766-4eb5ab1a1ee1 tempest-AttachVolumeTestJSON-1265919166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e75dda57-bf28-421e-83bc-59833834a5e2" returned: 0 in 1.006s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:54:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-43521a68-70d3-4b8f-ba9a-6e1052ffa251 req-c5f32eac-e766-4f01-9766-4eb5ab1a1ee1 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.043s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:54:58 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-43521a68-70d3-4b8f-ba9a-6e1052ffa251 req-c5f32eac-e766-4f01-9766-4eb5ab1a1ee1 tempest-AttachVolumeTestJSON-1265919166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-e75dda57-bf28-421e-83bc-59833834a5e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3fbfcce-95cf-4b74-b99a-5ed38588a30b', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 11:54:58 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-43521a68-70d3-4b8f-ba9a-6e1052ffa251 req-c5f32eac-e766-4f01-9766-4eb5ab1a1ee1 tempest-AttachVolumeTestJSON-1265919166 None] attachment_update completed successfully. Jun 03 11:54:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-106c4143-821c-417a-8842-808f2f681498 tempest-AttachVolumeShelveTestJSON-954507161 None] Acquiring lock "cinder-c41ea5af-5665-41b6-9fca-dbb060ce9011-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:54:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-106c4143-821c-417a-8842-808f2f681498 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "cinder-c41ea5af-5665-41b6-9fca-dbb060ce9011-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:54:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-106c4143-821c-417a-8842-808f2f681498 tempest-AttachVolumeShelveTestJSON-954507161 None] Acquiring lock "cinder-quobyte-c41ea5af-5665-41b6-9fca-dbb060ce9011" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:54:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-106c4143-821c-417a-8842-808f2f681498 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "cinder-quobyte-c41ea5af-5665-41b6-9fca-dbb060ce9011" acquired by "delete_volume" :: waited 0.026s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:54:59 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[06568961-d31f-4f24-b7ce-7f6eca5df9b9]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:54:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-106c4143-821c-417a-8842-808f2f681498 tempest-AttachVolumeShelveTestJSON-954507161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c41ea5af-5665-41b6-9fca-dbb060ce9011 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:54:59 devstack sudo[93133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c41ea5af-5665-41b6-9fca-dbb060ce9011 Jun 03 11:54:59 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:00 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-106c4143-821c-417a-8842-808f2f681498 tempest-AttachVolumeShelveTestJSON-954507161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c41ea5af-5665-41b6-9fca-dbb060ce9011" returned: 0 in 1.512s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-106c4143-821c-417a-8842-808f2f681498 tempest-AttachVolumeShelveTestJSON-954507161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c41ea5af-5665-41b6-9fca-dbb060ce9011 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:00 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c41ea5af-5665-41b6-9fca-dbb060ce9011 Jun 03 11:55:00 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:01 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-d1540d42-4eca-4d33-b889-e4494c2ca0f6 req-29af760a-8337-43af-b1ac-73d6fa4aa90c tempest-ServerActionsTestOtherA-128600654 None] Terminate volume connection completed successfully. Jun 03 11:55:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-d1540d42-4eca-4d33-b889-e4494c2ca0f6 req-29af760a-8337-43af-b1ac-73d6fa4aa90c tempest-ServerActionsTestOtherA-128600654 None] Deleting attachment 699d0a0c-c17f-420c-a9fe-53198c92204e. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 11:55:01 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-106c4143-821c-417a-8842-808f2f681498 tempest-AttachVolumeShelveTestJSON-954507161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c41ea5af-5665-41b6-9fca-dbb060ce9011" returned: 0 in 0.852s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:01 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-106c4143-821c-417a-8842-808f2f681498 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "cinder-quobyte-c41ea5af-5665-41b6-9fca-dbb060ce9011" released by "delete_volume" :: held 2.421s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:01 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-106c4143-821c-417a-8842-808f2f681498 tempest-AttachVolumeShelveTestJSON-954507161 None] Created reservations ['324c633d-f686-499a-bd68-02c880373a75', '46e97188-4122-40d8-8122-df34603d4080', '0a1fb64f-c927-467d-a42d-f692132f5f7e', 'b8312413-ca50-490a-a5d2-7a7d8832e6b1'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:55:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-106c4143-821c-417a-8842-808f2f681498 tempest-AttachVolumeShelveTestJSON-954507161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-106c4143-821c-417a-8842-808f2f681498 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-106c4143-821c-417a-8842-808f2f681498 tempest-AttachVolumeShelveTestJSON-954507161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:55:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-106c4143-821c-417a-8842-808f2f681498 tempest-AttachVolumeShelveTestJSON-954507161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:55:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-106c4143-821c-417a-8842-808f2f681498 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-106c4143-821c-417a-8842-808f2f681498 tempest-AttachVolumeShelveTestJSON-954507161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:01 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:55:01 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:02 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-106c4143-821c-417a-8842-808f2f681498 tempest-AttachVolumeShelveTestJSON-954507161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.650s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:02 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-106c4143-821c-417a-8842-808f2f681498 tempest-AttachVolumeShelveTestJSON-954507161 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:55:02 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-106c4143-821c-417a-8842-808f2f681498 tempest-AttachVolumeShelveTestJSON-954507161 None] Deleted volume successfully. Jun 03 11:55:02 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-106c4143-821c-417a-8842-808f2f681498 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "cinder-c41ea5af-5665-41b6-9fca-dbb060ce9011-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:02 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-420d184a-0f97-4326-9211-680bf5d7fad8 tempest-AttachVolumeShelveTestJSON-954507161 None] Acquiring lock "cinder-ebb20fcf-a798-448a-b04d-facefc9e122a-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:02 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-420d184a-0f97-4326-9211-680bf5d7fad8 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "cinder-ebb20fcf-a798-448a-b04d-facefc9e122a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:02 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-420d184a-0f97-4326-9211-680bf5d7fad8 tempest-AttachVolumeShelveTestJSON-954507161 None] Acquiring lock "cinder-quobyte-ebb20fcf-a798-448a-b04d-facefc9e122a" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:02 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-420d184a-0f97-4326-9211-680bf5d7fad8 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "cinder-quobyte-ebb20fcf-a798-448a-b04d-facefc9e122a" acquired by "delete_volume" :: waited 0.016s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:02 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ca696a-8519-4d6a-a75c-5aadb96f7bbc]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:55:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-420d184a-0f97-4326-9211-680bf5d7fad8 tempest-AttachVolumeShelveTestJSON-954507161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ebb20fcf-a798-448a-b04d-facefc9e122a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:02 devstack sudo[93522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ebb20fcf-a798-448a-b04d-facefc9e122a Jun 03 11:55:02 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-d1540d42-4eca-4d33-b889-e4494c2ca0f6 req-6a889958-cbf8-4b4f-8ac4-6dd385dcd609 tempest-ServerActionsTestOtherA-128600654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-d1540d42-4eca-4d33-b889-e4494c2ca0f6 req-6a889958-cbf8-4b4f-8ac4-6dd385dcd609 tempest-ServerActionsTestOtherA-128600654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:03 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7395ca-a8c6-4996-af0b-61044105eaea]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:55:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-d1540d42-4eca-4d33-b889-e4494c2ca0f6 req-6a889958-cbf8-4b4f-8ac4-6dd385dcd609 tempest-ServerActionsTestOtherA-128600654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4d942fd-0348-4fe8-bc4d-c57409689093 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:03 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-420d184a-0f97-4326-9211-680bf5d7fad8 tempest-AttachVolumeShelveTestJSON-954507161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ebb20fcf-a798-448a-b04d-facefc9e122a" returned: 0 in 1.073s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-420d184a-0f97-4326-9211-680bf5d7fad8 tempest-AttachVolumeShelveTestJSON-954507161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ebb20fcf-a798-448a-b04d-facefc9e122a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:03 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4d942fd-0348-4fe8-bc4d-c57409689093 Jun 03 11:55:03 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:03 devstack sudo[93541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ebb20fcf-a798-448a-b04d-facefc9e122a Jun 03 11:55:03 devstack sudo[93541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:04 devstack sudo[93541]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-420d184a-0f97-4326-9211-680bf5d7fad8 tempest-AttachVolumeShelveTestJSON-954507161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ebb20fcf-a798-448a-b04d-facefc9e122a" returned: 0 in 0.756s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:04 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-420d184a-0f97-4326-9211-680bf5d7fad8 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "cinder-quobyte-ebb20fcf-a798-448a-b04d-facefc9e122a" released by "delete_volume" :: held 1.879s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:04 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-420d184a-0f97-4326-9211-680bf5d7fad8 tempest-AttachVolumeShelveTestJSON-954507161 None] Created reservations ['cbf83a97-5868-4164-ae99-7962c2c7e5f1', '9dbf2b13-02e6-4a49-be41-7a0e8ab9f5d2', '3cefd5f6-954b-440f-81e8-a7c059c1a328', '75eaef9a-6923-404e-b1e4-f3dd958a30e9'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:55:04 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-d1540d42-4eca-4d33-b889-e4494c2ca0f6 req-6a889958-cbf8-4b4f-8ac4-6dd385dcd609 tempest-ServerActionsTestOtherA-128600654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4d942fd-0348-4fe8-bc4d-c57409689093" returned: 0 in 0.986s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-d1540d42-4eca-4d33-b889-e4494c2ca0f6 req-6a889958-cbf8-4b4f-8ac4-6dd385dcd609 tempest-ServerActionsTestOtherA-128600654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-d1540d42-4eca-4d33-b889-e4494c2ca0f6 req-6a889958-cbf8-4b4f-8ac4-6dd385dcd609 tempest-ServerActionsTestOtherA-128600654 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-d4d942fd-0348-4fe8-bc4d-c57409689093', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'adeb24dd-af82-4130-b0e1-3a6389fc169e', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 11:55:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-420d184a-0f97-4326-9211-680bf5d7fad8 tempest-AttachVolumeShelveTestJSON-954507161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-420d184a-0f97-4326-9211-680bf5d7fad8 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:04 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-420d184a-0f97-4326-9211-680bf5d7fad8 tempest-AttachVolumeShelveTestJSON-954507161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:55:04 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-420d184a-0f97-4326-9211-680bf5d7fad8 tempest-AttachVolumeShelveTestJSON-954507161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:55:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-420d184a-0f97-4326-9211-680bf5d7fad8 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-420d184a-0f97-4326-9211-680bf5d7fad8 tempest-AttachVolumeShelveTestJSON-954507161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:04 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:55:04 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:04 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-d1540d42-4eca-4d33-b889-e4494c2ca0f6 req-6a889958-cbf8-4b4f-8ac4-6dd385dcd609 tempest-ServerActionsTestOtherA-128600654 None] attachment_update completed successfully. Jun 03 11:55:05 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-2ef159fa-449a-44fb-99e1-f087d2b6871d req-6d8c43a3-9811-4771-82d6-bdd20a452872 tempest-AttachVolumeTestJSON-1265919166 None] Terminate volume connection completed successfully. Jun 03 11:55:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-2ef159fa-449a-44fb-99e1-f087d2b6871d req-6d8c43a3-9811-4771-82d6-bdd20a452872 tempest-AttachVolumeTestJSON-1265919166 None] Deleting attachment d21c2c89-e843-412d-8f4a-180b9ef350dd. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 11:55:05 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-420d184a-0f97-4326-9211-680bf5d7fad8 tempest-AttachVolumeShelveTestJSON-954507161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.779s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:05 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-420d184a-0f97-4326-9211-680bf5d7fad8 tempest-AttachVolumeShelveTestJSON-954507161 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:55:05 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-420d184a-0f97-4326-9211-680bf5d7fad8 tempest-AttachVolumeShelveTestJSON-954507161 None] Deleted volume successfully. Jun 03 11:55:05 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-420d184a-0f97-4326-9211-680bf5d7fad8 tempest-AttachVolumeShelveTestJSON-954507161 None] Lock "cinder-ebb20fcf-a798-448a-b04d-facefc9e122a-delete_volume" released by "delete_volume" :: held 2.975s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:07 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-59a4fcfc-5ff5-4c4b-9dce-e9f4e9520675 req-08104123-b7ae-42ff-8de7-582fc957999d tempest-AttachVolumeTestJSON-1265919166 None] Terminate volume connection completed successfully. Jun 03 11:55:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-59a4fcfc-5ff5-4c4b-9dce-e9f4e9520675 req-08104123-b7ae-42ff-8de7-582fc957999d tempest-AttachVolumeTestJSON-1265919166 None] Deleting attachment b3fbfcce-95cf-4b74-b99a-5ed38588a30b. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 11:55:13 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=50,cinder:UPDATE=33,cinder:DELETE=1,cinder:INSERT=3 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:55:13 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:UPDATE=34,cinder:SELECT=47,cinder:INSERT=8,cinder:DELETE=4 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:55:13 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:55:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Flow 'volume_create_manager' (29126394-36c1-4ba9-b55b-157d111586ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:55:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a151e52f-fc6a-4adb-b91d-fcbb8678a334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a151e52f-fc6a-4adb-b91d-fcbb8678a334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-864193092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6715dc0f-0093-4e85-9935-aea30b5f2321,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5770f0be709c47d0994a0706ab1f693b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:55:14Z,use_quota=True,user_id='732413106a9743be936789601b545bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecef53b5-2556-49bc-9597-75484cbee0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecef53b5-2556-49bc-9597-75484cbee0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4f69fd-f90c-4d9a-b1e7-696bf3c9ef0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4f69fd-f90c-4d9a-b1e7-696bf3c9ef0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6715dc0f-0093-4e85-9935-aea30b5f2321', 'volume_name': 'volume-6715dc0f-0093-4e85-9935-aea30b5f2321', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7fec1b-1b95-459c-897f-255652f5536a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7fec1b-1b95-459c-897f-255652f5536a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04dcdba8-ab17-4c2b-93f2-77a837fdaa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:14 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Volume 6715dc0f-0093-4e85-9935-aea30b5f2321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6715dc0f-0093-4e85-9935-aea30b5f2321', 'volume_size': 1} Jun 03 11:55:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:14 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-864193092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6715dc0f-0093-4e85-9935-aea30b5f2321,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5770f0be709c47d0994a0706ab1f693b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:55:14Z,use_quota=True,user_id='732413106a9743be936789601b545bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:55:14 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Creating volume 6715dc0f-0093-4e85-9935-aea30b5f2321 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:55:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:14 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:55:14 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:55:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:14 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:55:14 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:55:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6715dc0f-0093-4e85-9935-aea30b5f2321 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:14 devstack sudo[94161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6715dc0f-0093-4e85-9935-aea30b5f2321 1073741824 Jun 03 11:55:14 devstack sudo[94161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:15 devstack sudo[94161]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6715dc0f-0093-4e85-9935-aea30b5f2321 1073741824" returned: 0 in 0.948s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6715dc0f-0093-4e85-9935-aea30b5f2321 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:15 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6715dc0f-0093-4e85-9935-aea30b5f2321 Jun 03 11:55:15 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:15 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6715dc0f-0093-4e85-9935-aea30b5f2321" returned: 0 in 0.660s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:55:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04dcdba8-ab17-4c2b-93f2-77a837fdaa10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6715dc0f-0093-4e85-9935-aea30b5f2321', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e185f7f-9fb1-4260-aa3b-5e63750d1999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:15 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Volume volume-6715dc0f-0093-4e85-9935-aea30b5f2321 (6715dc0f-0093-4e85-9935-aea30b5f2321): created successfully Jun 03 11:55:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e185f7f-9fb1-4260-aa3b-5e63750d1999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Flow 'volume_create_manager' (29126394-36c1-4ba9-b55b-157d111586ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:55:15 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-48b141bf-d826-47db-b031-d448d8c79e5a req-a3c86473-dbd3-4a97-a03d-c530e2b87d9c tempest-VolumesGetTestJSON-1782512463 None] Created volume successfully. Jun 03 11:55:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-dbf12278-ac3e-4d3f-a5b3-06cf557fd0bf req-4407f8ed-f009-489c-9191-0cf1b1032f5a tempest-VolumesGetTestJSON-1782512463 None] Acquiring lock "cinder-6715dc0f-0093-4e85-9935-aea30b5f2321-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-dbf12278-ac3e-4d3f-a5b3-06cf557fd0bf req-4407f8ed-f009-489c-9191-0cf1b1032f5a tempest-VolumesGetTestJSON-1782512463 None] Lock "cinder-6715dc0f-0093-4e85-9935-aea30b5f2321-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-dbf12278-ac3e-4d3f-a5b3-06cf557fd0bf req-4407f8ed-f009-489c-9191-0cf1b1032f5a tempest-VolumesGetTestJSON-1782512463 None] Acquiring lock "cinder-quobyte-6715dc0f-0093-4e85-9935-aea30b5f2321" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-dbf12278-ac3e-4d3f-a5b3-06cf557fd0bf req-4407f8ed-f009-489c-9191-0cf1b1032f5a tempest-VolumesGetTestJSON-1782512463 None] Lock "cinder-quobyte-6715dc0f-0093-4e85-9935-aea30b5f2321" acquired by "delete_volume" :: waited 0.026s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:16 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed28238d-493e-49ec-8dbc-fa6d7dc29607]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:55:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-dbf12278-ac3e-4d3f-a5b3-06cf557fd0bf req-4407f8ed-f009-489c-9191-0cf1b1032f5a tempest-VolumesGetTestJSON-1782512463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6715dc0f-0093-4e85-9935-aea30b5f2321 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:16 devstack sudo[94170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6715dc0f-0093-4e85-9935-aea30b5f2321 Jun 03 11:55:16 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:17 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-dbf12278-ac3e-4d3f-a5b3-06cf557fd0bf req-4407f8ed-f009-489c-9191-0cf1b1032f5a tempest-VolumesGetTestJSON-1782512463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6715dc0f-0093-4e85-9935-aea30b5f2321" returned: 0 in 0.813s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-dbf12278-ac3e-4d3f-a5b3-06cf557fd0bf req-4407f8ed-f009-489c-9191-0cf1b1032f5a tempest-VolumesGetTestJSON-1782512463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6715dc0f-0093-4e85-9935-aea30b5f2321 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:17 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6715dc0f-0093-4e85-9935-aea30b5f2321 Jun 03 11:55:17 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:18 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-dbf12278-ac3e-4d3f-a5b3-06cf557fd0bf req-4407f8ed-f009-489c-9191-0cf1b1032f5a tempest-VolumesGetTestJSON-1782512463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6715dc0f-0093-4e85-9935-aea30b5f2321" returned: 0 in 0.671s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-dbf12278-ac3e-4d3f-a5b3-06cf557fd0bf req-4407f8ed-f009-489c-9191-0cf1b1032f5a tempest-VolumesGetTestJSON-1782512463 None] Lock "cinder-quobyte-6715dc0f-0093-4e85-9935-aea30b5f2321" released by "delete_volume" :: held 1.530s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:18 devstack cinder-volume[86724]: DEBUG cinder.quota [req-dbf12278-ac3e-4d3f-a5b3-06cf557fd0bf req-4407f8ed-f009-489c-9191-0cf1b1032f5a tempest-VolumesGetTestJSON-1782512463 None] Created reservations ['023bf14c-f7c1-4aa7-b2df-86a0ef52f5b7', 'ff34ede8-5298-495d-b1c0-6fb56c96aecd', '218ef440-25aa-40aa-a783-b07e7d233516', '252bb751-593e-47a0-84f6-ac5ff31d2de9'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:55:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-dbf12278-ac3e-4d3f-a5b3-06cf557fd0bf req-4407f8ed-f009-489c-9191-0cf1b1032f5a tempest-VolumesGetTestJSON-1782512463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-dbf12278-ac3e-4d3f-a5b3-06cf557fd0bf req-4407f8ed-f009-489c-9191-0cf1b1032f5a tempest-VolumesGetTestJSON-1782512463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [req-dbf12278-ac3e-4d3f-a5b3-06cf557fd0bf req-4407f8ed-f009-489c-9191-0cf1b1032f5a tempest-VolumesGetTestJSON-1782512463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:55:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [req-dbf12278-ac3e-4d3f-a5b3-06cf557fd0bf req-4407f8ed-f009-489c-9191-0cf1b1032f5a tempest-VolumesGetTestJSON-1782512463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:55:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-dbf12278-ac3e-4d3f-a5b3-06cf557fd0bf req-4407f8ed-f009-489c-9191-0cf1b1032f5a tempest-VolumesGetTestJSON-1782512463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-dbf12278-ac3e-4d3f-a5b3-06cf557fd0bf req-4407f8ed-f009-489c-9191-0cf1b1032f5a tempest-VolumesGetTestJSON-1782512463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:18 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:55:18 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:19 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-dbf12278-ac3e-4d3f-a5b3-06cf557fd0bf req-4407f8ed-f009-489c-9191-0cf1b1032f5a tempest-VolumesGetTestJSON-1782512463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.825s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:19 devstack cinder-volume[86724]: DEBUG cinder.manager [req-dbf12278-ac3e-4d3f-a5b3-06cf557fd0bf req-4407f8ed-f009-489c-9191-0cf1b1032f5a tempest-VolumesGetTestJSON-1782512463 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:55:19 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-dbf12278-ac3e-4d3f-a5b3-06cf557fd0bf req-4407f8ed-f009-489c-9191-0cf1b1032f5a tempest-VolumesGetTestJSON-1782512463 None] Deleted volume successfully. Jun 03 11:55:19 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-dbf12278-ac3e-4d3f-a5b3-06cf557fd0bf req-4407f8ed-f009-489c-9191-0cf1b1032f5a tempest-VolumesGetTestJSON-1782512463 None] Lock "cinder-6715dc0f-0093-4e85-9935-aea30b5f2321-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:19 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-74ffb40b-3ccd-457a-8637-34c54eff1412 tempest-AttachVolumeTestJSON-1265919166 None] Acquiring lock "cinder-e75dda57-bf28-421e-83bc-59833834a5e2-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:19 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-74ffb40b-3ccd-457a-8637-34c54eff1412 tempest-AttachVolumeTestJSON-1265919166 None] Lock "cinder-e75dda57-bf28-421e-83bc-59833834a5e2-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:19 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-74ffb40b-3ccd-457a-8637-34c54eff1412 tempest-AttachVolumeTestJSON-1265919166 None] Acquiring lock "cinder-quobyte-e75dda57-bf28-421e-83bc-59833834a5e2" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:19 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-74ffb40b-3ccd-457a-8637-34c54eff1412 tempest-AttachVolumeTestJSON-1265919166 None] Lock "cinder-quobyte-e75dda57-bf28-421e-83bc-59833834a5e2" acquired by "delete_volume" :: waited 0.028s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:19 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0b3c45-1786-4836-9a3e-cdb7d0734b71]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:55:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-74ffb40b-3ccd-457a-8637-34c54eff1412 tempest-AttachVolumeTestJSON-1265919166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e75dda57-bf28-421e-83bc-59833834a5e2 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:20 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e75dda57-bf28-421e-83bc-59833834a5e2 Jun 03 11:55:20 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:21 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-74ffb40b-3ccd-457a-8637-34c54eff1412 tempest-AttachVolumeTestJSON-1265919166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e75dda57-bf28-421e-83bc-59833834a5e2" returned: 0 in 1.049s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-74ffb40b-3ccd-457a-8637-34c54eff1412 tempest-AttachVolumeTestJSON-1265919166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e75dda57-bf28-421e-83bc-59833834a5e2 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:21 devstack sudo[94208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e75dda57-bf28-421e-83bc-59833834a5e2 Jun 03 11:55:21 devstack sudo[94208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Flow 'volume_create_manager' (39b31498-51d9-4fb0-a32e-6ac3fff281f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc6404a-8363-4c96-8770-bcf5f7663ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc6404a-8363-4c96-8770-bcf5f7663ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1625394796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e4e7721-9856-4093-bb68-f16a2378f98b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6de29b8bd84b30aa342263448fc61b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:55:22Z,use_quota=True,user_id='0a6a18593a884177b948787d36a36211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d96172-afa9-4490-9a49-5e9006b4d5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d96172-afa9-4490-9a49-5e9006b4d5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e27002-3c4f-42b8-8ce5-d8d0804be7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e27002-3c4f-42b8-8ce5-d8d0804be7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e4e7721-9856-4093-bb68-f16a2378f98b', 'volume_name': 'volume-8e4e7721-9856-4093-bb68-f16a2378f98b', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a25c3b-d692-4dc4-9d86-eed247bc1c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a25c3b-d692-4dc4-9d86-eed247bc1c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59037329-3be7-4a9d-bfb1-cbe624f9e8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:21 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Volume 8e4e7721-9856-4093-bb68-f16a2378f98b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e4e7721-9856-4093-bb68-f16a2378f98b', 'volume_size': 1} Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1625394796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e4e7721-9856-4093-bb68-f16a2378f98b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6de29b8bd84b30aa342263448fc61b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:55:22Z,use_quota=True,user_id='0a6a18593a884177b948787d36a36211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Creating volume 8e4e7721-9856-4093-bb68-f16a2378f98b {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:55:21 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:55:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8e4e7721-9856-4093-bb68-f16a2378f98b 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:21 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8e4e7721-9856-4093-bb68-f16a2378f98b 1073741824 Jun 03 11:55:21 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:22 devstack sudo[94208]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-74ffb40b-3ccd-457a-8637-34c54eff1412 tempest-AttachVolumeTestJSON-1265919166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e75dda57-bf28-421e-83bc-59833834a5e2" returned: 0 in 1.053s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-74ffb40b-3ccd-457a-8637-34c54eff1412 tempest-AttachVolumeTestJSON-1265919166 None] Lock "cinder-quobyte-e75dda57-bf28-421e-83bc-59833834a5e2" released by "delete_volume" :: held 2.167s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:22 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-74ffb40b-3ccd-457a-8637-34c54eff1412 tempest-AttachVolumeTestJSON-1265919166 None] Created reservations ['bb84ac06-4473-4072-aaf5-62946537a5f1', '380b2d8b-c2da-449d-b914-fc59139be491', 'fc37b455-84e5-4941-9def-cce44c6abe9d', '65c55615-c61a-471e-85c7-9be7e0eaaac7'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:55:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-74ffb40b-3ccd-457a-8637-34c54eff1412 tempest-AttachVolumeTestJSON-1265919166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-74ffb40b-3ccd-457a-8637-34c54eff1412 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-74ffb40b-3ccd-457a-8637-34c54eff1412 tempest-AttachVolumeTestJSON-1265919166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:55:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-74ffb40b-3ccd-457a-8637-34c54eff1412 tempest-AttachVolumeTestJSON-1265919166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:55:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-74ffb40b-3ccd-457a-8637-34c54eff1412 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-74ffb40b-3ccd-457a-8637-34c54eff1412 tempest-AttachVolumeTestJSON-1265919166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:22 devstack sudo[94218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:55:22 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:22 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8e4e7721-9856-4093-bb68-f16a2378f98b 1073741824" returned: 0 in 1.248s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8e4e7721-9856-4093-bb68-f16a2378f98b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:23 devstack sudo[94224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8e4e7721-9856-4093-bb68-f16a2378f98b Jun 03 11:55:23 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:23 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-74ffb40b-3ccd-457a-8637-34c54eff1412 tempest-AttachVolumeTestJSON-1265919166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.875s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:23 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-74ffb40b-3ccd-457a-8637-34c54eff1412 tempest-AttachVolumeTestJSON-1265919166 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:55:23 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-74ffb40b-3ccd-457a-8637-34c54eff1412 tempest-AttachVolumeTestJSON-1265919166 None] Deleted volume successfully. Jun 03 11:55:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-74ffb40b-3ccd-457a-8637-34c54eff1412 tempest-AttachVolumeTestJSON-1265919166 None] Lock "cinder-e75dda57-bf28-421e-83bc-59833834a5e2-delete_volume" released by "delete_volume" :: held 3.386s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4c6b3b5a-d0b3-429a-8cbb-ad7a7c109d01 tempest-AttachVolumeTestJSON-1265919166 None] Acquiring lock "cinder-0454b651-6718-4d7c-ac8c-df2066d33c5d-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4c6b3b5a-d0b3-429a-8cbb-ad7a7c109d01 tempest-AttachVolumeTestJSON-1265919166 None] Lock "cinder-0454b651-6718-4d7c-ac8c-df2066d33c5d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4c6b3b5a-d0b3-429a-8cbb-ad7a7c109d01 tempest-AttachVolumeTestJSON-1265919166 None] Acquiring lock "cinder-quobyte-0454b651-6718-4d7c-ac8c-df2066d33c5d" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4c6b3b5a-d0b3-429a-8cbb-ad7a7c109d01 tempest-AttachVolumeTestJSON-1265919166 None] Lock "cinder-quobyte-0454b651-6718-4d7c-ac8c-df2066d33c5d" acquired by "delete_volume" :: waited 0.045s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:23 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[241375d2-39d9-40cc-b380-00162e91ac1f]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:55:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4c6b3b5a-d0b3-429a-8cbb-ad7a7c109d01 tempest-AttachVolumeTestJSON-1265919166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0454b651-6718-4d7c-ac8c-df2066d33c5d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:23 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0454b651-6718-4d7c-ac8c-df2066d33c5d Jun 03 11:55:23 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:23 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8e4e7721-9856-4093-bb68-f16a2378f98b" returned: 0 in 0.939s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:23 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] <== create_volume: return (2238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:55:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.242s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:23 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59037329-3be7-4a9d-bfb1-cbe624f9e8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e4e7721-9856-4093-bb68-f16a2378f98b', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:23 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0924244-7b91-4620-acb1-4d6d7143359e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:24 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Volume volume-8e4e7721-9856-4093-bb68-f16a2378f98b (8e4e7721-9856-4093-bb68-f16a2378f98b): created successfully Jun 03 11:55:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0924244-7b91-4620-acb1-4d6d7143359e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Flow 'volume_create_manager' (39b31498-51d9-4fb0-a32e-6ac3fff281f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:55:24 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-fb9a4d17-faee-4612-b424-9c204b6d9a64 tempest-AttachVolumeNegativeTest-954122186 None] Created volume successfully. Jun 03 11:55:24 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-68ebd784-e470-4cab-b574-0cb54a2086bf tempest-GroupsV320Test-390978163 None] Group tempest-GroupsV320Test-Group-1372449429: creating Jun 03 11:55:24 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-68ebd784-e470-4cab-b574-0cb54a2086bf tempest-GroupsV320Test-390978163 None] Group tempest-GroupsV320Test-Group-1372449429: created successfully Jun 03 11:55:24 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-68ebd784-e470-4cab-b574-0cb54a2086bf tempest-GroupsV320Test-390978163 None] Create group completed successfully. Jun 03 11:55:24 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4c6b3b5a-d0b3-429a-8cbb-ad7a7c109d01 tempest-AttachVolumeTestJSON-1265919166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0454b651-6718-4d7c-ac8c-df2066d33c5d" returned: 0 in 0.926s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4c6b3b5a-d0b3-429a-8cbb-ad7a7c109d01 tempest-AttachVolumeTestJSON-1265919166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0454b651-6718-4d7c-ac8c-df2066d33c5d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:24 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0454b651-6718-4d7c-ac8c-df2066d33c5d Jun 03 11:55:24 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:25 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4c6b3b5a-d0b3-429a-8cbb-ad7a7c109d01 tempest-AttachVolumeTestJSON-1265919166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0454b651-6718-4d7c-ac8c-df2066d33c5d" returned: 0 in 0.744s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4c6b3b5a-d0b3-429a-8cbb-ad7a7c109d01 tempest-AttachVolumeTestJSON-1265919166 None] Lock "cinder-quobyte-0454b651-6718-4d7c-ac8c-df2066d33c5d" released by "delete_volume" :: held 1.729s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:25 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-4c6b3b5a-d0b3-429a-8cbb-ad7a7c109d01 tempest-AttachVolumeTestJSON-1265919166 None] Created reservations ['9166b904-526b-40ba-a27d-23e271bcb805', 'a89d755b-3884-42df-b6aa-e77392855c09', '775c79bc-97f7-495f-9adf-be4443cfba09', 'be967a71-f866-48c4-91ee-601b52bdd6aa'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:55:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4c6b3b5a-d0b3-429a-8cbb-ad7a7c109d01 tempest-AttachVolumeTestJSON-1265919166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4c6b3b5a-d0b3-429a-8cbb-ad7a7c109d01 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:25 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4c6b3b5a-d0b3-429a-8cbb-ad7a7c109d01 tempest-AttachVolumeTestJSON-1265919166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:55:25 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4c6b3b5a-d0b3-429a-8cbb-ad7a7c109d01 tempest-AttachVolumeTestJSON-1265919166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:55:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4c6b3b5a-d0b3-429a-8cbb-ad7a7c109d01 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4c6b3b5a-d0b3-429a-8cbb-ad7a7c109d01 tempest-AttachVolumeTestJSON-1265919166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:25 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:55:25 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c34fcfbf-94e4-4005-99d8-5bc6d8770ee4 tempest-AttachVolumeTestJSON-1265919166 None] Acquiring lock "cinder-29495f3e-7450-44d3-bf23-834e82cef934-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c34fcfbf-94e4-4005-99d8-5bc6d8770ee4 tempest-AttachVolumeTestJSON-1265919166 None] Lock "cinder-29495f3e-7450-44d3-bf23-834e82cef934-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c34fcfbf-94e4-4005-99d8-5bc6d8770ee4 tempest-AttachVolumeTestJSON-1265919166 None] Acquiring lock "cinder-quobyte-29495f3e-7450-44d3-bf23-834e82cef934" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c34fcfbf-94e4-4005-99d8-5bc6d8770ee4 tempest-AttachVolumeTestJSON-1265919166 None] Lock "cinder-quobyte-29495f3e-7450-44d3-bf23-834e82cef934" acquired by "delete_volume" :: waited 0.019s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:25 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2f87f2-b3ac-4236-b63b-a639e75e7755]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:55:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c34fcfbf-94e4-4005-99d8-5bc6d8770ee4 tempest-AttachVolumeTestJSON-1265919166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-29495f3e-7450-44d3-bf23-834e82cef934 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:26 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-256d946b-fb51-4f51-bd5a-cbea536ca5c9 tempest-GroupsV320Test-390978163 None] Created reservations ['b73b3bb2-eef6-44ff-8a7e-42e2316e1781'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:55:26 devstack sudo[94270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-29495f3e-7450-44d3-bf23-834e82cef934 Jun 03 11:55:26 devstack sudo[94270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-256d946b-fb51-4f51-bd5a-cbea536ca5c9 tempest-GroupsV320Test-390978163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-256d946b-fb51-4f51-bd5a-cbea536ca5c9 tempest-GroupsV320Test-390978163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:26 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-256d946b-fb51-4f51-bd5a-cbea536ca5c9 tempest-GroupsV320Test-390978163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:55:26 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-256d946b-fb51-4f51-bd5a-cbea536ca5c9 tempest-GroupsV320Test-390978163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:55:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-256d946b-fb51-4f51-bd5a-cbea536ca5c9 tempest-GroupsV320Test-390978163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-256d946b-fb51-4f51-bd5a-cbea536ca5c9 tempest-GroupsV320Test-390978163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:26 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4c6b3b5a-d0b3-429a-8cbb-ad7a7c109d01 tempest-AttachVolumeTestJSON-1265919166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.675s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:26 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-4c6b3b5a-d0b3-429a-8cbb-ad7a7c109d01 tempest-AttachVolumeTestJSON-1265919166 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:55:26 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:55:26 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:26 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-4c6b3b5a-d0b3-429a-8cbb-ad7a7c109d01 tempest-AttachVolumeTestJSON-1265919166 None] Deleted volume successfully. Jun 03 11:55:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4c6b3b5a-d0b3-429a-8cbb-ad7a7c109d01 tempest-AttachVolumeTestJSON-1265919166 None] Lock "cinder-0454b651-6718-4d7c-ac8c-df2066d33c5d-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:26 devstack sudo[94270]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c34fcfbf-94e4-4005-99d8-5bc6d8770ee4 tempest-AttachVolumeTestJSON-1265919166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-29495f3e-7450-44d3-bf23-834e82cef934" returned: 0 in 0.757s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c34fcfbf-94e4-4005-99d8-5bc6d8770ee4 tempest-AttachVolumeTestJSON-1265919166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-29495f3e-7450-44d3-bf23-834e82cef934 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:26 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-29495f3e-7450-44d3-bf23-834e82cef934 Jun 03 11:55:26 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:26 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-256d946b-fb51-4f51-bd5a-cbea536ca5c9 tempest-GroupsV320Test-390978163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.658s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:26 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-256d946b-fb51-4f51-bd5a-cbea536ca5c9 tempest-GroupsV320Test-390978163 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:55:26 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-256d946b-fb51-4f51-bd5a-cbea536ca5c9 tempest-GroupsV320Test-390978163 None] Delete group completed successfully. Jun 03 11:55:27 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c34fcfbf-94e4-4005-99d8-5bc6d8770ee4 tempest-AttachVolumeTestJSON-1265919166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-29495f3e-7450-44d3-bf23-834e82cef934" returned: 0 in 0.641s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c34fcfbf-94e4-4005-99d8-5bc6d8770ee4 tempest-AttachVolumeTestJSON-1265919166 None] Lock "cinder-quobyte-29495f3e-7450-44d3-bf23-834e82cef934" released by "delete_volume" :: held 1.462s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:27 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-c34fcfbf-94e4-4005-99d8-5bc6d8770ee4 tempest-AttachVolumeTestJSON-1265919166 None] Created reservations ['a58d8928-9ad9-4de0-b31a-fc0d04c44211', '3bad267f-7330-416c-9882-306a6a5e3e9e', '6dec3b5e-2864-48d8-b128-b63393da62e5', '3aee32c8-5bfd-45ed-854e-69dd7edb36b9'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:55:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c34fcfbf-94e4-4005-99d8-5bc6d8770ee4 tempest-AttachVolumeTestJSON-1265919166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c34fcfbf-94e4-4005-99d8-5bc6d8770ee4 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c34fcfbf-94e4-4005-99d8-5bc6d8770ee4 tempest-AttachVolumeTestJSON-1265919166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:55:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c34fcfbf-94e4-4005-99d8-5bc6d8770ee4 tempest-AttachVolumeTestJSON-1265919166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:55:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c34fcfbf-94e4-4005-99d8-5bc6d8770ee4 tempest-AttachVolumeTestJSON-1265919166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c34fcfbf-94e4-4005-99d8-5bc6d8770ee4 tempest-AttachVolumeTestJSON-1265919166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:27 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:55:27 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-77046d93-5129-4dce-ae64-3e166cb5ed74 req-654ca07a-9b03-45a3-bdb4-84693784099f tempest-AttachVolumeNegativeTest-954122186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-77046d93-5129-4dce-ae64-3e166cb5ed74 req-654ca07a-9b03-45a3-bdb4-84693784099f tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:28 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c2b790-dbd6-4601-aa37-72c07dbf936a]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:55:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-77046d93-5129-4dce-ae64-3e166cb5ed74 req-654ca07a-9b03-45a3-bdb4-84693784099f tempest-AttachVolumeNegativeTest-954122186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8e4e7721-9856-4093-bb68-f16a2378f98b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:28 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c34fcfbf-94e4-4005-99d8-5bc6d8770ee4 tempest-AttachVolumeTestJSON-1265919166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.666s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:28 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-c34fcfbf-94e4-4005-99d8-5bc6d8770ee4 tempest-AttachVolumeTestJSON-1265919166 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:55:28 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c34fcfbf-94e4-4005-99d8-5bc6d8770ee4 tempest-AttachVolumeTestJSON-1265919166 None] Deleted volume successfully. Jun 03 11:55:28 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c34fcfbf-94e4-4005-99d8-5bc6d8770ee4 tempest-AttachVolumeTestJSON-1265919166 None] Lock "cinder-29495f3e-7450-44d3-bf23-834e82cef934-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:28 devstack sudo[94293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8e4e7721-9856-4093-bb68-f16a2378f98b Jun 03 11:55:28 devstack sudo[94293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:28 devstack sudo[94293]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-77046d93-5129-4dce-ae64-3e166cb5ed74 req-654ca07a-9b03-45a3-bdb4-84693784099f tempest-AttachVolumeNegativeTest-954122186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8e4e7721-9856-4093-bb68-f16a2378f98b" returned: 0 in 0.911s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-77046d93-5129-4dce-ae64-3e166cb5ed74 req-654ca07a-9b03-45a3-bdb4-84693784099f tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.937s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-77046d93-5129-4dce-ae64-3e166cb5ed74 req-654ca07a-9b03-45a3-bdb4-84693784099f tempest-AttachVolumeNegativeTest-954122186 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-8e4e7721-9856-4093-bb68-f16a2378f98b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f2c0fe7-5a16-4a47-bb72-a515739fa26d', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 11:55:29 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-77046d93-5129-4dce-ae64-3e166cb5ed74 req-654ca07a-9b03-45a3-bdb4-84693784099f tempest-AttachVolumeNegativeTest-954122186 None] attachment_update completed successfully. Jun 03 11:55:35 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-397968fd-cd6a-46fd-b2b1-43d38aeba969 req-692f2ae0-56d8-442d-b0bd-10929fa4908f tempest-AttachVolumeNegativeTest-954122186 None] Terminate volume connection completed successfully. Jun 03 11:55:35 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-397968fd-cd6a-46fd-b2b1-43d38aeba969 req-692f2ae0-56d8-442d-b0bd-10929fa4908f tempest-AttachVolumeNegativeTest-954122186 None] Deleting attachment 0f2c0fe7-5a16-4a47-bb72-a515739fa26d. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Flow 'volume_create_manager' (2b768793-a6f8-4782-ad9b-83973d39156a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70882b6-f799-422c-b41f-924293372f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70882b6-f799-422c-b41f-924293372f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1007863207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f3b201-dd4a-4a5d-b991-58da04930040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7d0ce6ee614270a7419a1d3d7e79db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:55:36Z,use_quota=True,user_id='e2a0abb1e02f4b888763af770b17fb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f834f8-eedd-4cb9-bac6-01c7628b6da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f834f8-eedd-4cb9-bac6-01c7628b6da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c62a6bfc-3bc8-49d0-9fce-d6abb379d5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c62a6bfc-3bc8-49d0-9fce-d6abb379d5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5f3b201-dd4a-4a5d-b991-58da04930040', 'volume_name': 'volume-a5f3b201-dd4a-4a5d-b991-58da04930040', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e1a8cb-0780-47b8-b0d1-7c0da1e36fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e1a8cb-0780-47b8-b0d1-7c0da1e36fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eff342a-cf22-4dbe-92ab-6e4b58352e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:36 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Volume a5f3b201-dd4a-4a5d-b991-58da04930040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5f3b201-dd4a-4a5d-b991-58da04930040', 'volume_size': 1} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1007863207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f3b201-dd4a-4a5d-b991-58da04930040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7d0ce6ee614270a7419a1d3d7e79db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:55:36Z,use_quota=True,user_id='e2a0abb1e02f4b888763af770b17fb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Creating volume a5f3b201-dd4a-4a5d-b991-58da04930040 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:55:36 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:36 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040 1073741824 Jun 03 11:55:36 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:36 devstack sudo[94334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:55:36 devstack sudo[94334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:37 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-4e0b9e14-d3f5-4754-a618-0e29dbc60912 req-3f0ec4e6-1e4c-4d87-a355-5f882a37ecde tempest-ServerActionsTestOtherA-128600654 None] Terminate volume connection completed successfully. Jun 03 11:55:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-4e0b9e14-d3f5-4754-a618-0e29dbc60912 req-3f0ec4e6-1e4c-4d87-a355-5f882a37ecde tempest-ServerActionsTestOtherA-128600654 None] Deleting attachment adeb24dd-af82-4130-b0e1-3a6389fc169e. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 11:55:37 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040 1073741824" returned: 0 in 1.011s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:37 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040 Jun 03 11:55:37 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:37 devstack sudo[94334]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.837s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:37 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:55:38 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040" returned: 0 in 0.712s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:55:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eff342a-cf22-4dbe-92ab-6e4b58352e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5f3b201-dd4a-4a5d-b991-58da04930040', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746e4af1-2b93-4826-8e49-be85225de210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:38 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Volume volume-a5f3b201-dd4a-4a5d-b991-58da04930040 (a5f3b201-dd4a-4a5d-b991-58da04930040): created successfully Jun 03 11:55:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746e4af1-2b93-4826-8e49-be85225de210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Flow 'volume_create_manager' (2b768793-a6f8-4782-ad9b-83973d39156a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:55:38 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-58434f4d-0e44-41ce-b695-46ddb48a201f req-b45a4a81-cb07-4a25-9664-3cdb2ea5bc09 tempest-VolumesSnapshotsTestJSON-1093585819 None] Created volume successfully. Jun 03 11:55:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-8ed2497a-16f7-49a1-b867-f11d9f3a0994 req-081153c0-9711-4fde-ae3e-f83ce940f929 tempest-VolumesSnapshotsTestJSON-1093585819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-8ed2497a-16f7-49a1-b867-f11d9f3a0994 req-081153c0-9711-4fde-ae3e-f83ce940f929 tempest-VolumesSnapshotsTestJSON-1093585819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [req-8ed2497a-16f7-49a1-b867-f11d9f3a0994 req-081153c0-9711-4fde-ae3e-f83ce940f929 tempest-VolumesSnapshotsTestJSON-1093585819 None] Creating offline snapshot f31e356f-b649-4c88-93c9-33a1bb13fe23 of volume a5f3b201-dd4a-4a5d-b991-58da04930040 {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 11:55:39 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[302df539-c4d4-4baa-a6bd-ef8e8de16221]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:55:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-8ed2497a-16f7-49a1-b867-f11d9f3a0994 req-081153c0-9711-4fde-ae3e-f83ce940f929 tempest-VolumesSnapshotsTestJSON-1093585819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:39 devstack sudo[94384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040 Jun 03 11:55:39 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:40 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-8ed2497a-16f7-49a1-b867-f11d9f3a0994 req-081153c0-9711-4fde-ae3e-f83ce940f929 tempest-VolumesSnapshotsTestJSON-1093585819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040" returned: 0 in 0.969s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-8ed2497a-16f7-49a1-b867-f11d9f3a0994 req-081153c0-9711-4fde-ae3e-f83ce940f929 tempest-VolumesSnapshotsTestJSON-1093585819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.f31e356f-b649-4c88-93c9-33a1bb13fe23 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:40 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.f31e356f-b649-4c88-93c9-33a1bb13fe23 1G Jun 03 11:55:40 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:41 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-8ed2497a-16f7-49a1-b867-f11d9f3a0994 req-081153c0-9711-4fde-ae3e-f83ce940f929 tempest-VolumesSnapshotsTestJSON-1093585819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.f31e356f-b649-4c88-93c9-33a1bb13fe23 1G" returned: 0 in 1.218s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-8ed2497a-16f7-49a1-b867-f11d9f3a0994 req-081153c0-9711-4fde-ae3e-f83ce940f929 tempest-VolumesSnapshotsTestJSON-1093585819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5f3b201-dd4a-4a5d-b991-58da04930040 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.f31e356f-b649-4c88-93c9-33a1bb13fe23 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:41 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5f3b201-dd4a-4a5d-b991-58da04930040 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.f31e356f-b649-4c88-93c9-33a1bb13fe23 Jun 03 11:55:41 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:42 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-8ed2497a-16f7-49a1-b867-f11d9f3a0994 req-081153c0-9711-4fde-ae3e-f83ce940f929 tempest-VolumesSnapshotsTestJSON-1093585819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5f3b201-dd4a-4a5d-b991-58da04930040 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.f31e356f-b649-4c88-93c9-33a1bb13fe23" returned: 0 in 0.788s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:42 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [req-8ed2497a-16f7-49a1-b867-f11d9f3a0994 req-081153c0-9711-4fde-ae3e-f83ce940f929 tempest-VolumesSnapshotsTestJSON-1093585819 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.f31e356f-b649-4c88-93c9-33a1bb13fe23 is being set with open permissions: ugo+rw Jun 03 11:55:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-8ed2497a-16f7-49a1-b867-f11d9f3a0994 req-081153c0-9711-4fde-ae3e-f83ce940f929 tempest-VolumesSnapshotsTestJSON-1093585819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.f31e356f-b649-4c88-93c9-33a1bb13fe23 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:42 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.f31e356f-b649-4c88-93c9-33a1bb13fe23 Jun 03 11:55:42 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:42 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-8ed2497a-16f7-49a1-b867-f11d9f3a0994 req-081153c0-9711-4fde-ae3e-f83ce940f929 tempest-VolumesSnapshotsTestJSON-1093585819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.f31e356f-b649-4c88-93c9-33a1bb13fe23" returned: 0 in 0.839s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-8ed2497a-16f7-49a1-b867-f11d9f3a0994 req-081153c0-9711-4fde-ae3e-f83ce940f929 tempest-VolumesSnapshotsTestJSON-1093585819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:43 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.info Jun 03 11:55:43 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:43 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-8ed2497a-16f7-49a1-b867-f11d9f3a0994 req-081153c0-9711-4fde-ae3e-f83ce940f929 tempest-VolumesSnapshotsTestJSON-1093585819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.info" returned: 0 in 0.655s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:43 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [req-8ed2497a-16f7-49a1-b867-f11d9f3a0994 req-081153c0-9711-4fde-ae3e-f83ce940f929 tempest-VolumesSnapshotsTestJSON-1093585819 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.info is being set with open permissions: ugo+rw Jun 03 11:55:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-8ed2497a-16f7-49a1-b867-f11d9f3a0994 req-081153c0-9711-4fde-ae3e-f83ce940f929 tempest-VolumesSnapshotsTestJSON-1093585819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:43 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.info Jun 03 11:55:43 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:44 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-8ed2497a-16f7-49a1-b867-f11d9f3a0994 req-081153c0-9711-4fde-ae3e-f83ce940f929 tempest-VolumesSnapshotsTestJSON-1093585819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.info" returned: 0 in 0.662s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-8ed2497a-16f7-49a1-b867-f11d9f3a0994 req-081153c0-9711-4fde-ae3e-f83ce940f929 tempest-VolumesSnapshotsTestJSON-1093585819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.267s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:44 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-8ed2497a-16f7-49a1-b867-f11d9f3a0994 req-081153c0-9711-4fde-ae3e-f83ce940f929 tempest-VolumesSnapshotsTestJSON-1093585819 None] Create snapshot completed successfully Jun 03 11:55:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] Acquiring lock "cinder-f31e356f-b649-4c88-93c9-33a1bb13fe23-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] Lock "cinder-f31e356f-b649-4c88-93c9-33a1bb13fe23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] Acquiring lock "cinder-quobyte-a5f3b201-dd4a-4a5d-b991-58da04930040" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] Lock "cinder-quobyte-a5f3b201-dd4a-4a5d-b991-58da04930040" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] Acquiring lock "cinder-quobyte-f31e356f-b649-4c88-93c9-33a1bb13fe23" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] Lock "cinder-quobyte-f31e356f-b649-4c88-93c9-33a1bb13fe23" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] Deleting offline snapshot f31e356f-b649-4c88-93c9-33a1bb13fe23 of volume a5f3b201-dd4a-4a5d-b991-58da04930040 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 11:55:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] snapshot_file for this snap is: volume-a5f3b201-dd4a-4a5d-b991-58da04930040.f31e356f-b649-4c88-93c9-33a1bb13fe23 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 11:55:45 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c98da1-420b-4318-ae43-85fdbdc8dd72]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:55:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.f31e356f-b649-4c88-93c9-33a1bb13fe23 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:45 devstack sudo[94453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.f31e356f-b649-4c88-93c9-33a1bb13fe23 Jun 03 11:55:45 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:46 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.f31e356f-b649-4c88-93c9-33a1bb13fe23" returned: 0 in 0.876s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5f3b201-dd4a-4a5d-b991-58da04930040(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c44514c-9a73-4346-88b3-859853f5523c]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Flow 'volume_create_manager' (237b8167-335f-4720-a1fb-a69048dc9815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41df0e70-34a6-44a6-b496-f73af81bf329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5c4913de-d59f-426a-94ad-19c35689a1f8 tempest-AttachVolumeNegativeTest-954122186 None] Acquiring lock "cinder-8e4e7721-9856-4093-bb68-f16a2378f98b-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41df0e70-34a6-44a6-b496-f73af81bf329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2049459464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0533a5fa-33f3-4920-a979-9922ef33120f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12a79b2b184140069c187faed7816095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:55:46Z,use_quota=True,user_id='305b91967c73435b9eed42fd77ece817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c2d01a-4b4a-4c07-ba90-da7d3080851b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c2d01a-4b4a-4c07-ba90-da7d3080851b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffce675-30a5-43bc-99f2-45bc834ce059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffce675-30a5-43bc-99f2-45bc834ce059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0533a5fa-33f3-4920-a979-9922ef33120f', 'volume_name': 'volume-0533a5fa-33f3-4920-a979-9922ef33120f', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d602caf8-10be-4037-8960-a248af562752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d602caf8-10be-4037-8960-a248af562752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55926592-d109-49ba-97bd-351b6b07947d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:46 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Volume 0533a5fa-33f3-4920-a979-9922ef33120f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0533a5fa-33f3-4920-a979-9922ef33120f', 'volume_size': 1} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2049459464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0533a5fa-33f3-4920-a979-9922ef33120f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12a79b2b184140069c187faed7816095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:55:46Z,use_quota=True,user_id='305b91967c73435b9eed42fd77ece817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Creating volume 0533a5fa-33f3-4920-a979-9922ef33120f {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:55:46 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040 Jun 03 11:55:46 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:55:46 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0533a5fa-33f3-4920-a979-9922ef33120f 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5c4913de-d59f-426a-94ad-19c35689a1f8 tempest-AttachVolumeNegativeTest-954122186 None] Lock "cinder-8e4e7721-9856-4093-bb68-f16a2378f98b-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:46 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0533a5fa-33f3-4920-a979-9922ef33120f 1073741824 Jun 03 11:55:46 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5c4913de-d59f-426a-94ad-19c35689a1f8 tempest-AttachVolumeNegativeTest-954122186 None] Acquiring lock "cinder-quobyte-8e4e7721-9856-4093-bb68-f16a2378f98b" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5c4913de-d59f-426a-94ad-19c35689a1f8 tempest-AttachVolumeNegativeTest-954122186 None] Lock "cinder-quobyte-8e4e7721-9856-4093-bb68-f16a2378f98b" acquired by "delete_volume" :: waited 0.021s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fe8393-5422-442f-b442-9a0f8703d93f]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:55:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5c4913de-d59f-426a-94ad-19c35689a1f8 tempest-AttachVolumeNegativeTest-954122186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8e4e7721-9856-4093-bb68-f16a2378f98b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:46 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8e4e7721-9856-4093-bb68-f16a2378f98b Jun 03 11:55:46 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:47 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040" returned: 0 in 0.917s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.f31e356f-b649-4c88-93c9-33a1bb13fe23 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:47 devstack sudo[94472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.f31e356f-b649-4c88-93c9-33a1bb13fe23 Jun 03 11:55:47 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b827b602-3951-47e2-82a5-3ebbd55b77c5 tempest-ServerActionsTestOtherA-128600654 None] Acquiring lock "cinder-d4d942fd-0348-4fe8-bc4d-c57409689093-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b827b602-3951-47e2-82a5-3ebbd55b77c5 tempest-ServerActionsTestOtherA-128600654 None] Lock "cinder-d4d942fd-0348-4fe8-bc4d-c57409689093-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:47 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:47 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0533a5fa-33f3-4920-a979-9922ef33120f 1073741824" returned: 0 in 0.988s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5c4913de-d59f-426a-94ad-19c35689a1f8 tempest-AttachVolumeNegativeTest-954122186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8e4e7721-9856-4093-bb68-f16a2378f98b" returned: 0 in 0.876s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b827b602-3951-47e2-82a5-3ebbd55b77c5 tempest-ServerActionsTestOtherA-128600654 None] Acquiring lock "cinder-quobyte-d4d942fd-0348-4fe8-bc4d-c57409689093" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5c4913de-d59f-426a-94ad-19c35689a1f8 tempest-AttachVolumeNegativeTest-954122186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8e4e7721-9856-4093-bb68-f16a2378f98b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:47 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8e4e7721-9856-4093-bb68-f16a2378f98b Jun 03 11:55:47 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0533a5fa-33f3-4920-a979-9922ef33120f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b827b602-3951-47e2-82a5-3ebbd55b77c5 tempest-ServerActionsTestOtherA-128600654 None] Lock "cinder-quobyte-d4d942fd-0348-4fe8-bc4d-c57409689093" acquired by "delete_volume" :: waited 0.064s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:47 devstack sudo[94480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0533a5fa-33f3-4920-a979-9922ef33120f Jun 03 11:55:47 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:47 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df6f687-62f0-407a-8b8e-9463ee10ffe2]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:55:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b827b602-3951-47e2-82a5-3ebbd55b77c5 tempest-ServerActionsTestOtherA-128600654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4d942fd-0348-4fe8-bc4d-c57409689093 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:47 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4d942fd-0348-4fe8-bc4d-c57409689093 Jun 03 11:55:47 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:48 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.f31e356f-b649-4c88-93c9-33a1bb13fe23" returned: 0 in 0.797s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.f31e356f-b649-4c88-93c9-33a1bb13fe23 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:48 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.f31e356f-b649-4c88-93c9-33a1bb13fe23 Jun 03 11:55:48 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:48 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5c4913de-d59f-426a-94ad-19c35689a1f8 tempest-AttachVolumeNegativeTest-954122186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8e4e7721-9856-4093-bb68-f16a2378f98b" returned: 0 in 0.708s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:48 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5c4913de-d59f-426a-94ad-19c35689a1f8 tempest-AttachVolumeNegativeTest-954122186 None] Lock "cinder-quobyte-8e4e7721-9856-4093-bb68-f16a2378f98b" released by "delete_volume" :: held 1.653s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0533a5fa-33f3-4920-a979-9922ef33120f" returned: 0 in 0.686s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55926592-d109-49ba-97bd-351b6b07947d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0533a5fa-33f3-4920-a979-9922ef33120f', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221c0927-ce1e-4750-854c-3cde94a26d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:55:48 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Volume volume-0533a5fa-33f3-4920-a979-9922ef33120f (0533a5fa-33f3-4920-a979-9922ef33120f): created successfully Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221c0927-ce1e-4750-854c-3cde94a26d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Flow 'volume_create_manager' (237b8167-335f-4720-a1fb-a69048dc9815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:55:48 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c7641f63-8d11-45e7-a15b-089d85c00e81 tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Created volume successfully. Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-5c4913de-d59f-426a-94ad-19c35689a1f8 tempest-AttachVolumeNegativeTest-954122186 None] Created reservations ['891e130a-5a45-4363-a228-d909362b6a6c', '692d037f-8c86-4708-84e2-e3e22e46d7ba', '6ccbaae0-e7eb-426c-8f25-d23b7f1dab3b', 'c8b17417-6ea2-491c-a7ed-5e23d88b9575'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:55:48 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b827b602-3951-47e2-82a5-3ebbd55b77c5 tempest-ServerActionsTestOtherA-128600654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4d942fd-0348-4fe8-bc4d-c57409689093" returned: 0 in 0.789s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b827b602-3951-47e2-82a5-3ebbd55b77c5 tempest-ServerActionsTestOtherA-128600654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4d942fd-0348-4fe8-bc4d-c57409689093 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5c4913de-d59f-426a-94ad-19c35689a1f8 tempest-AttachVolumeNegativeTest-954122186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5c4913de-d59f-426a-94ad-19c35689a1f8 tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5c4913de-d59f-426a-94ad-19c35689a1f8 tempest-AttachVolumeNegativeTest-954122186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5c4913de-d59f-426a-94ad-19c35689a1f8 tempest-AttachVolumeNegativeTest-954122186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5c4913de-d59f-426a-94ad-19c35689a1f8 tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5c4913de-d59f-426a-94ad-19c35689a1f8 tempest-AttachVolumeNegativeTest-954122186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:48 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4d942fd-0348-4fe8-bc4d-c57409689093 Jun 03 11:55:48 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:48 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:55:48 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:48 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040.f31e356f-b649-4c88-93c9-33a1bb13fe23" returned: 0 in 0.711s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] Lock "cinder-quobyte-f31e356f-b649-4c88-93c9-33a1bb13fe23" released by "_delete_snapshot" :: held 3.482s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] Lock "cinder-quobyte-a5f3b201-dd4a-4a5d-b991-58da04930040" released by "delete_snapshot" :: held 3.512s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:48 devstack cinder-volume[86724]: WARNING cinder.quota [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:55:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4197930a-fef5-42cd-93b3-af4ad2aef16d tempest-AttachVolumeNegativeTest-954122186 None] Acquiring lock "cinder-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG cinder.quota [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] Created reservations ['61b7d443-baef-47b8-bff7-a9e457b2427e', '8eab4e4b-b68f-4472-b8f0-fbcc03b6adf8', '6ad5303a-868e-4fb3-9994-8b6819e0b8f4', '2d67f28a-8c52-421a-9027-f3ee6f50396b'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4197930a-fef5-42cd-93b3-af4ad2aef16d tempest-AttachVolumeNegativeTest-954122186 None] Lock "cinder-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4197930a-fef5-42cd-93b3-af4ad2aef16d tempest-AttachVolumeNegativeTest-954122186 None] Acquiring lock "cinder-quobyte-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:49 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] Delete snapshot completed successfully. Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4197930a-fef5-42cd-93b3-af4ad2aef16d tempest-AttachVolumeNegativeTest-954122186 None] Lock "cinder-quobyte-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd" acquired by "delete_volume" :: waited 0.029s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-dd49914e-6389-49d9-bd02-a7514d0f480d req-d089da38-5a0a-4f56-a5d2-9345292272ce tempest-VolumesSnapshotsTestJSON-1093585819 None] Lock "cinder-f31e356f-b649-4c88-93c9-33a1bb13fe23-delete_snapshot" released by "delete_snapshot" :: held 3.820s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7e616a-0dec-40be-9c25-9f5d5e317733]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4197930a-fef5-42cd-93b3-af4ad2aef16d tempest-AttachVolumeNegativeTest-954122186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:49 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5c4913de-d59f-426a-94ad-19c35689a1f8 tempest-AttachVolumeNegativeTest-954122186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.809s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5c4913de-d59f-426a-94ad-19c35689a1f8 tempest-AttachVolumeNegativeTest-954122186 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:55:49 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-5c4913de-d59f-426a-94ad-19c35689a1f8 tempest-AttachVolumeNegativeTest-954122186 None] Deleted volume successfully. Jun 03 11:55:49 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd Jun 03 11:55:49 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5c4913de-d59f-426a-94ad-19c35689a1f8 tempest-AttachVolumeNegativeTest-954122186 None] Lock "cinder-8e4e7721-9856-4093-bb68-f16a2378f98b-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:49 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b827b602-3951-47e2-82a5-3ebbd55b77c5 tempest-ServerActionsTestOtherA-128600654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4d942fd-0348-4fe8-bc4d-c57409689093" returned: 0 in 0.907s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b827b602-3951-47e2-82a5-3ebbd55b77c5 tempest-ServerActionsTestOtherA-128600654 None] Lock "cinder-quobyte-d4d942fd-0348-4fe8-bc4d-c57409689093" released by "delete_volume" :: held 1.761s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-b827b602-3951-47e2-82a5-3ebbd55b77c5 tempest-ServerActionsTestOtherA-128600654 None] Created reservations ['4fa5c565-1ecc-4882-afa7-cedcf48c36b4', 'f2a0e216-7adf-4d2b-b63c-0286910fc6e3', 'b28d040c-58ce-4860-97b0-4448f29615e3', '20810ef9-79f8-42dd-98a0-b1fef21363e3'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b827b602-3951-47e2-82a5-3ebbd55b77c5 tempest-ServerActionsTestOtherA-128600654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b827b602-3951-47e2-82a5-3ebbd55b77c5 tempest-ServerActionsTestOtherA-128600654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b827b602-3951-47e2-82a5-3ebbd55b77c5 tempest-ServerActionsTestOtherA-128600654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b827b602-3951-47e2-82a5-3ebbd55b77c5 tempest-ServerActionsTestOtherA-128600654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b827b602-3951-47e2-82a5-3ebbd55b77c5 tempest-ServerActionsTestOtherA-128600654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b827b602-3951-47e2-82a5-3ebbd55b77c5 tempest-ServerActionsTestOtherA-128600654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:49 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:55:49 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-86bae13a-f3cb-48e9-94da-6673efe6b23e tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Acquiring lock "cinder-0533a5fa-33f3-4920-a979-9922ef33120f-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-86bae13a-f3cb-48e9-94da-6673efe6b23e tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Lock "cinder-0533a5fa-33f3-4920-a979-9922ef33120f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-28dd5a1c-c757-4c54-ab7b-04f7077556ed req-f979e7ef-3ace-43a7-b5ef-5a7bb9957ef6 tempest-VolumesSnapshotsTestJSON-1093585819 None] Acquiring lock "cinder-a5f3b201-dd4a-4a5d-b991-58da04930040-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-28dd5a1c-c757-4c54-ab7b-04f7077556ed req-f979e7ef-3ace-43a7-b5ef-5a7bb9957ef6 tempest-VolumesSnapshotsTestJSON-1093585819 None] Lock "cinder-a5f3b201-dd4a-4a5d-b991-58da04930040-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-86bae13a-f3cb-48e9-94da-6673efe6b23e tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Acquiring lock "cinder-quobyte-0533a5fa-33f3-4920-a979-9922ef33120f" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-86bae13a-f3cb-48e9-94da-6673efe6b23e tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Lock "cinder-quobyte-0533a5fa-33f3-4920-a979-9922ef33120f" acquired by "delete_volume" :: waited 0.033s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-28dd5a1c-c757-4c54-ab7b-04f7077556ed req-f979e7ef-3ace-43a7-b5ef-5a7bb9957ef6 tempest-VolumesSnapshotsTestJSON-1093585819 None] Acquiring lock "cinder-quobyte-a5f3b201-dd4a-4a5d-b991-58da04930040" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:50 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[95528cf0-68c6-4103-8574-d6f7c7a9638f]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:55:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-86bae13a-f3cb-48e9-94da-6673efe6b23e tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0533a5fa-33f3-4920-a979-9922ef33120f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-28dd5a1c-c757-4c54-ab7b-04f7077556ed req-f979e7ef-3ace-43a7-b5ef-5a7bb9957ef6 tempest-VolumesSnapshotsTestJSON-1093585819 None] Lock "cinder-quobyte-a5f3b201-dd4a-4a5d-b991-58da04930040" acquired by "delete_volume" :: waited 0.055s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:50 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cf93cc-c7ce-4875-a2c9-27f827c78c81]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:55:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-28dd5a1c-c757-4c54-ab7b-04f7077556ed req-f979e7ef-3ace-43a7-b5ef-5a7bb9957ef6 tempest-VolumesSnapshotsTestJSON-1093585819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:50 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0533a5fa-33f3-4920-a979-9922ef33120f Jun 03 11:55:50 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:50 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4197930a-fef5-42cd-93b3-af4ad2aef16d tempest-AttachVolumeNegativeTest-954122186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd" returned: 0 in 1.237s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4197930a-fef5-42cd-93b3-af4ad2aef16d tempest-AttachVolumeNegativeTest-954122186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:50 devstack sudo[94546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040 Jun 03 11:55:50 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:50 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd Jun 03 11:55:50 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:50 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b827b602-3951-47e2-82a5-3ebbd55b77c5 tempest-ServerActionsTestOtherA-128600654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.056s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:50 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-b827b602-3951-47e2-82a5-3ebbd55b77c5 tempest-ServerActionsTestOtherA-128600654 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:55:50 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-b827b602-3951-47e2-82a5-3ebbd55b77c5 tempest-ServerActionsTestOtherA-128600654 None] Deleted volume successfully. Jun 03 11:55:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b827b602-3951-47e2-82a5-3ebbd55b77c5 tempest-ServerActionsTestOtherA-128600654 None] Lock "cinder-d4d942fd-0348-4fe8-bc4d-c57409689093-delete_volume" released by "delete_volume" :: held 3.170s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:51 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-28dd5a1c-c757-4c54-ab7b-04f7077556ed req-f979e7ef-3ace-43a7-b5ef-5a7bb9957ef6 tempest-VolumesSnapshotsTestJSON-1093585819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040" returned: 0 in 0.888s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-28dd5a1c-c757-4c54-ab7b-04f7077556ed req-f979e7ef-3ace-43a7-b5ef-5a7bb9957ef6 tempest-VolumesSnapshotsTestJSON-1093585819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:51 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040 Jun 03 11:55:51 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:51 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4197930a-fef5-42cd-93b3-af4ad2aef16d tempest-AttachVolumeNegativeTest-954122186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd" returned: 0 in 0.896s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:51 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4197930a-fef5-42cd-93b3-af4ad2aef16d tempest-AttachVolumeNegativeTest-954122186 None] Lock "cinder-quobyte-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd" released by "delete_volume" :: held 2.219s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:51 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-86bae13a-f3cb-48e9-94da-6673efe6b23e tempest-VolumeQuotasNegativeTestJSON-1673935271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0533a5fa-33f3-4920-a979-9922ef33120f" returned: 0 in 1.214s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-86bae13a-f3cb-48e9-94da-6673efe6b23e tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0533a5fa-33f3-4920-a979-9922ef33120f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:51 devstack sudo[94606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0533a5fa-33f3-4920-a979-9922ef33120f Jun 03 11:55:51 devstack sudo[94606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:51 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-4197930a-fef5-42cd-93b3-af4ad2aef16d tempest-AttachVolumeNegativeTest-954122186 None] Created reservations ['8a2bbee0-0279-447e-a68c-6764d4fc2888', 'a1196ad1-4a3f-40af-9948-ae7e4699f0d9', 'd334a78c-e51a-4e6e-b1a2-31838f0964a0', 'e0de71ad-76e4-4908-8c9b-a6555741810a'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:55:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4197930a-fef5-42cd-93b3-af4ad2aef16d tempest-AttachVolumeNegativeTest-954122186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4197930a-fef5-42cd-93b3-af4ad2aef16d tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4197930a-fef5-42cd-93b3-af4ad2aef16d tempest-AttachVolumeNegativeTest-954122186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:55:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4197930a-fef5-42cd-93b3-af4ad2aef16d tempest-AttachVolumeNegativeTest-954122186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:55:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4197930a-fef5-42cd-93b3-af4ad2aef16d tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4197930a-fef5-42cd-93b3-af4ad2aef16d tempest-AttachVolumeNegativeTest-954122186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:51 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:55:51 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:52 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-28dd5a1c-c757-4c54-ab7b-04f7077556ed req-f979e7ef-3ace-43a7-b5ef-5a7bb9957ef6 tempest-VolumesSnapshotsTestJSON-1093585819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a5f3b201-dd4a-4a5d-b991-58da04930040" returned: 0 in 0.969s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-28dd5a1c-c757-4c54-ab7b-04f7077556ed req-f979e7ef-3ace-43a7-b5ef-5a7bb9957ef6 tempest-VolumesSnapshotsTestJSON-1093585819 None] Lock "cinder-quobyte-a5f3b201-dd4a-4a5d-b991-58da04930040" released by "delete_volume" :: held 1.967s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG cinder.quota [req-28dd5a1c-c757-4c54-ab7b-04f7077556ed req-f979e7ef-3ace-43a7-b5ef-5a7bb9957ef6 tempest-VolumesSnapshotsTestJSON-1093585819 None] Created reservations ['44fb8584-358d-4d40-8e92-c6c53005e80e', 'f2093e4e-c25d-4902-82c3-307c2c3ec5e4', '4b48f228-fb8b-441e-a83b-81d1b852bc41', 'fb046512-01bf-451a-9492-5c0e4390b739'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:55:52 devstack sudo[94606]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-86bae13a-f3cb-48e9-94da-6673efe6b23e tempest-VolumeQuotasNegativeTestJSON-1673935271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0533a5fa-33f3-4920-a979-9922ef33120f" returned: 0 in 0.894s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-86bae13a-f3cb-48e9-94da-6673efe6b23e tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Lock "cinder-quobyte-0533a5fa-33f3-4920-a979-9922ef33120f" released by "delete_volume" :: held 2.196s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-28dd5a1c-c757-4c54-ab7b-04f7077556ed req-f979e7ef-3ace-43a7-b5ef-5a7bb9957ef6 tempest-VolumesSnapshotsTestJSON-1093585819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-28dd5a1c-c757-4c54-ab7b-04f7077556ed req-f979e7ef-3ace-43a7-b5ef-5a7bb9957ef6 tempest-VolumesSnapshotsTestJSON-1093585819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [req-28dd5a1c-c757-4c54-ab7b-04f7077556ed req-f979e7ef-3ace-43a7-b5ef-5a7bb9957ef6 tempest-VolumesSnapshotsTestJSON-1093585819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:55:52 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [req-28dd5a1c-c757-4c54-ab7b-04f7077556ed req-f979e7ef-3ace-43a7-b5ef-5a7bb9957ef6 tempest-VolumesSnapshotsTestJSON-1093585819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-28dd5a1c-c757-4c54-ab7b-04f7077556ed req-f979e7ef-3ace-43a7-b5ef-5a7bb9957ef6 tempest-VolumesSnapshotsTestJSON-1093585819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-28dd5a1c-c757-4c54-ab7b-04f7077556ed req-f979e7ef-3ace-43a7-b5ef-5a7bb9957ef6 tempest-VolumesSnapshotsTestJSON-1093585819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4197930a-fef5-42cd-93b3-af4ad2aef16d tempest-AttachVolumeNegativeTest-954122186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.744s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-4197930a-fef5-42cd-93b3-af4ad2aef16d tempest-AttachVolumeNegativeTest-954122186 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:55:52 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-4197930a-fef5-42cd-93b3-af4ad2aef16d tempest-AttachVolumeNegativeTest-954122186 None] Deleted volume successfully. Jun 03 11:55:52 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:55:52 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4197930a-fef5-42cd-93b3-af4ad2aef16d tempest-AttachVolumeNegativeTest-954122186 None] Lock "cinder-9bd24fc1-eb2b-4a79-89ce-5b5d6028a7dd-delete_volume" released by "delete_volume" :: held 3.353s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-86bae13a-f3cb-48e9-94da-6673efe6b23e tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Created reservations ['2231fe07-4e19-4df2-9b0e-3e4ffe5dba7c', 'd91b20b7-e645-4ee4-972c-cd3a52a95076', '5d16125d-b863-446a-805c-1624942da68c', 'e2f3277f-8790-48bf-9723-02c824a66fa6'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-86bae13a-f3cb-48e9-94da-6673efe6b23e tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-86bae13a-f3cb-48e9-94da-6673efe6b23e tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-86bae13a-f3cb-48e9-94da-6673efe6b23e tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-86bae13a-f3cb-48e9-94da-6673efe6b23e tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-86bae13a-f3cb-48e9-94da-6673efe6b23e tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-86bae13a-f3cb-48e9-94da-6673efe6b23e tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:52 devstack sudo[94618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:55:52 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-163853c8-477f-4505-91be-e53560ae4756 tempest-AttachVolumeNegativeTest-954122186 None] Acquiring lock "cinder-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-163853c8-477f-4505-91be-e53560ae4756 tempest-AttachVolumeNegativeTest-954122186 None] Lock "cinder-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-163853c8-477f-4505-91be-e53560ae4756 tempest-AttachVolumeNegativeTest-954122186 None] Acquiring lock "cinder-quobyte-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-163853c8-477f-4505-91be-e53560ae4756 tempest-AttachVolumeNegativeTest-954122186 None] Lock "cinder-quobyte-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7" acquired by "delete_volume" :: waited 0.024s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb5c795-9c92-4a2e-b717-0353654cda7a]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:55:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-163853c8-477f-4505-91be-e53560ae4756 tempest-AttachVolumeNegativeTest-954122186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:53 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7 Jun 03 11:55:53 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:53 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-28dd5a1c-c757-4c54-ab7b-04f7077556ed req-f979e7ef-3ace-43a7-b5ef-5a7bb9957ef6 tempest-VolumesSnapshotsTestJSON-1093585819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.010s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:53 devstack cinder-volume[86724]: DEBUG cinder.manager [req-28dd5a1c-c757-4c54-ab7b-04f7077556ed req-f979e7ef-3ace-43a7-b5ef-5a7bb9957ef6 tempest-VolumesSnapshotsTestJSON-1093585819 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:55:53 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-28dd5a1c-c757-4c54-ab7b-04f7077556ed req-f979e7ef-3ace-43a7-b5ef-5a7bb9957ef6 tempest-VolumesSnapshotsTestJSON-1093585819 None] Deleted volume successfully. Jun 03 11:55:53 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-28dd5a1c-c757-4c54-ab7b-04f7077556ed req-f979e7ef-3ace-43a7-b5ef-5a7bb9957ef6 tempest-VolumesSnapshotsTestJSON-1093585819 None] Lock "cinder-a5f3b201-dd4a-4a5d-b991-58da04930040-delete_volume" released by "delete_volume" :: held 3.367s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:53 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-86bae13a-f3cb-48e9-94da-6673efe6b23e tempest-VolumeQuotasNegativeTestJSON-1673935271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.016s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:53 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-86bae13a-f3cb-48e9-94da-6673efe6b23e tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:55:53 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-86bae13a-f3cb-48e9-94da-6673efe6b23e tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Deleted volume successfully. Jun 03 11:55:53 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-86bae13a-f3cb-48e9-94da-6673efe6b23e tempest-VolumeQuotasNegativeTestJSON-1673935271 None] Lock "cinder-0533a5fa-33f3-4920-a979-9922ef33120f-delete_volume" released by "delete_volume" :: held 3.603s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:54 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-163853c8-477f-4505-91be-e53560ae4756 tempest-AttachVolumeNegativeTest-954122186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7" returned: 0 in 1.241s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-163853c8-477f-4505-91be-e53560ae4756 tempest-AttachVolumeNegativeTest-954122186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:54 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7 Jun 03 11:55:54 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:54 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-163853c8-477f-4505-91be-e53560ae4756 tempest-AttachVolumeNegativeTest-954122186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7" returned: 0 in 0.799s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-163853c8-477f-4505-91be-e53560ae4756 tempest-AttachVolumeNegativeTest-954122186 None] Lock "cinder-quobyte-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7" released by "delete_volume" :: held 2.117s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:55:55 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-163853c8-477f-4505-91be-e53560ae4756 tempest-AttachVolumeNegativeTest-954122186 None] Created reservations ['84f39741-3f3f-4ff9-9987-cc67006f5d24', '899532f8-3161-4e27-89a9-95ca02e37c69', '13dcb953-9461-4a1c-9110-217e0b591ceb', '9f681c72-0126-490d-a926-6157eade8c87'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:55:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-163853c8-477f-4505-91be-e53560ae4756 tempest-AttachVolumeNegativeTest-954122186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:55:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-163853c8-477f-4505-91be-e53560ae4756 tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:55:55 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-163853c8-477f-4505-91be-e53560ae4756 tempest-AttachVolumeNegativeTest-954122186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:55:55 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-163853c8-477f-4505-91be-e53560ae4756 tempest-AttachVolumeNegativeTest-954122186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:55:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-163853c8-477f-4505-91be-e53560ae4756 tempest-AttachVolumeNegativeTest-954122186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:55:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-163853c8-477f-4505-91be-e53560ae4756 tempest-AttachVolumeNegativeTest-954122186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:55:55 devstack sudo[94634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:55:55 devstack sudo[94634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:55:55 devstack sudo[94634]: pam_unix(sudo:session): session closed for user root Jun 03 11:55:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-163853c8-477f-4505-91be-e53560ae4756 tempest-AttachVolumeNegativeTest-954122186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.820s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:55:55 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-163853c8-477f-4505-91be-e53560ae4756 tempest-AttachVolumeNegativeTest-954122186 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:55:55 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-163853c8-477f-4505-91be-e53560ae4756 tempest-AttachVolumeNegativeTest-954122186 None] Deleted volume successfully. Jun 03 11:55:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-163853c8-477f-4505-91be-e53560ae4756 tempest-AttachVolumeNegativeTest-954122186 None] Lock "cinder-19ee6b32-ff1c-4a3a-a6b9-8b510d890ad7-delete_volume" released by "delete_volume" :: held 3.230s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Flow 'volume_create_manager' (019526cf-bbcc-4eb1-962e-4e88b741cd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216fefd2-19d3-467b-bcd2-0d7ed0be9d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216fefd2-19d3-467b-bcd2-0d7ed0be9d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1788582624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f315fa0082a481986cbc94df35ba4d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:56:00Z,use_quota=True,user_id='463a8e9a9b724468af990da132e1ee09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f70656d1-66cb-446a-ad52-9d4a318406ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f70656d1-66cb-446a-ad52-9d4a318406ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0cadf08-4d61-4072-8fc2-660f55967f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0cadf08-4d61-4072-8fc2-660f55967f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe', 'volume_name': 'volume-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555c8ebc-e311-4293-ba9f-a5296f23170e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555c8ebc-e311-4293-ba9f-a5296f23170e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fca4990-e47e-4ffd-b8f9-12eb9f248ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:00 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Volume 5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe', 'volume_size': 1} Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1788582624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f315fa0082a481986cbc94df35ba4d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:56:00Z,use_quota=True,user_id='463a8e9a9b724468af990da132e1ee09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Creating volume 5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:56:00 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:56:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:00 devstack sudo[94639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe 1073741824 Jun 03 11:56:00 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:01 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe 1073741824" returned: 0 in 1.102s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:01 devstack sudo[94649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe Jun 03 11:56:01 devstack sudo[94649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:02 devstack sudo[94649]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe" returned: 0 in 0.731s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:02 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:56:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fca4990-e47e-4ffd-b8f9-12eb9f248ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e07038c-e4cd-4d02-8c20-eba8b41b9689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:02 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Volume volume-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe (5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe): created successfully Jun 03 11:56:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e07038c-e4cd-4d02-8c20-eba8b41b9689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Flow 'volume_create_manager' (019526cf-bbcc-4eb1-962e-4e88b741cd49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:56:02 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d7226cf6-3e09-456a-be4a-ee30fd7e3934 tempest-VolumesServicesTestJSON-1317706963 None] Created volume successfully. Jun 03 11:56:03 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-1d52b4f1-7d37-4557-8bd6-5568474e35be tempest-GroupSnapshotsTest-1791220728 None] Group tempest-GroupSnapshotsTest-Group-275650768: creating Jun 03 11:56:03 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-1d52b4f1-7d37-4557-8bd6-5568474e35be tempest-GroupSnapshotsTest-1791220728 None] Group tempest-GroupSnapshotsTest-Group-275650768: created successfully Jun 03 11:56:03 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-1d52b4f1-7d37-4557-8bd6-5568474e35be tempest-GroupSnapshotsTest-1791220728 None] Create group completed successfully. Jun 03 11:56:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0d46731b-24dd-4de4-a736-9eda896e5d2a tempest-VolumesServicesTestJSON-1317706963 None] Acquiring lock "cinder-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0d46731b-24dd-4de4-a736-9eda896e5d2a tempest-VolumesServicesTestJSON-1317706963 None] Lock "cinder-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0d46731b-24dd-4de4-a736-9eda896e5d2a tempest-VolumesServicesTestJSON-1317706963 None] Acquiring lock "cinder-quobyte-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0d46731b-24dd-4de4-a736-9eda896e5d2a tempest-VolumesServicesTestJSON-1317706963 None] Lock "cinder-quobyte-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe" acquired by "delete_volume" :: waited 0.043s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:03 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e09a15-14d3-430d-a34a-26d3bfa12711]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:56:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0d46731b-24dd-4de4-a736-9eda896e5d2a tempest-VolumesServicesTestJSON-1317706963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:04 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe Jun 03 11:56:04 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:04 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0d46731b-24dd-4de4-a736-9eda896e5d2a tempest-VolumesServicesTestJSON-1317706963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe" returned: 0 in 0.908s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0d46731b-24dd-4de4-a736-9eda896e5d2a tempest-VolumesServicesTestJSON-1317706963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:04 devstack sudo[94662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe Jun 03 11:56:04 devstack sudo[94662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:04 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Flow 'volume_create_manager' (24430109-d442-49b9-834e-cb36b0b98cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6bf5fb-20d2-4db4-9c9e-aa2db41a4ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6bf5fb-20d2-4db4-9c9e-aa2db41a4ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1425670677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a741be-98fd-4ad6-b8a6-280de493bfa3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cc507f15df3b480ea1cf6b1f22331b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:56:05Z,use_quota=True,user_id='87992c4e7d204d5ea9b7cbd6d64a968a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d1dfd9-3c7c-4c0e-8e01-0980940e47ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d1dfd9-3c7c-4c0e-8e01-0980940e47ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a296d588-324f-4f00-9a1d-e5805d2035a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a296d588-324f-4f00-9a1d-e5805d2035a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39a741be-98fd-4ad6-b8a6-280de493bfa3', 'volume_name': 'volume-39a741be-98fd-4ad6-b8a6-280de493bfa3', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5586d798-0f06-4fed-8e8f-c49a6afc42a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5586d798-0f06-4fed-8e8f-c49a6afc42a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ba1e39-318f-468d-b72b-49bb652d4a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:05 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Volume 39a741be-98fd-4ad6-b8a6-280de493bfa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39a741be-98fd-4ad6-b8a6-280de493bfa3', 'volume_size': 1} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1425670677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a741be-98fd-4ad6-b8a6-280de493bfa3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cc507f15df3b480ea1cf6b1f22331b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:56:05Z,use_quota=True,user_id='87992c4e7d204d5ea9b7cbd6d64a968a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Creating volume 39a741be-98fd-4ad6-b8a6-280de493bfa3 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:56:05 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39a741be-98fd-4ad6-b8a6-280de493bfa3 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:05 devstack sudo[94664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39a741be-98fd-4ad6-b8a6-280de493bfa3 1073741824 Jun 03 11:56:05 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Flow 'volume_create_manager' (07306f08-863e-4792-8d8d-8936d0c02609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb95e05-b019-4ce8-a2f1-1f1e7fc48f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb95e05-b019-4ce8-a2f1-1f1e7fc48f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-803429813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fdc91124-78d5-46ca-abbf-96bcc98754f4,host='devstack@QuobyteHD#QuobyteHD',id=2e8e3982-4f88-434f-bbb9-a7962b755ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c723860b5754be586565fb00f9436d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:56:05Z,use_quota=True,user_id='57defcafdfbc41ae93c472fc75992aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7221189-78ed-4123-b4c9-c8fd1a66ef35),volume_type_id=e7221189-78ed-4123-b4c9-c8fd1a66ef35)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd6a712-0c30-4fa9-81d4-7b3657a2b63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd6a712-0c30-4fa9-81d4-7b3657a2b63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692c5c27-13fd-41f2-b9f9-f8382eb919e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692c5c27-13fd-41f2-b9f9-f8382eb919e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e8e3982-4f88-434f-bbb9-a7962b755ef4', 'volume_name': 'volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3393b33-be7e-41d8-a07c-78e2731f1ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3393b33-be7e-41d8-a07c-78e2731f1ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde1bb6a-e5f1-43cb-bea0-e90d85617ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:05 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Volume 2e8e3982-4f88-434f-bbb9-a7962b755ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4', 'volume_size': 1} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:05 devstack sudo[94662]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0d46731b-24dd-4de4-a736-9eda896e5d2a tempest-VolumesServicesTestJSON-1317706963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe" returned: 0 in 0.786s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0d46731b-24dd-4de4-a736-9eda896e5d2a tempest-VolumesServicesTestJSON-1317706963 None] Lock "cinder-quobyte-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe" released by "delete_volume" :: held 1.739s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-0d46731b-24dd-4de4-a736-9eda896e5d2a tempest-VolumesServicesTestJSON-1317706963 None] Created reservations ['3763e05a-0d22-4cff-9bec-91214bf30a05', 'f8097a6a-269b-4389-a026-1eb9aaca5f2a', '37b01fdb-3b13-48c8-95da-3fda52ec4c7d', 'af7f66ad-6e73-42cf-914b-89f9e27bb09d'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0d46731b-24dd-4de4-a736-9eda896e5d2a tempest-VolumesServicesTestJSON-1317706963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0d46731b-24dd-4de4-a736-9eda896e5d2a tempest-VolumesServicesTestJSON-1317706963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0d46731b-24dd-4de4-a736-9eda896e5d2a tempest-VolumesServicesTestJSON-1317706963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0d46731b-24dd-4de4-a736-9eda896e5d2a tempest-VolumesServicesTestJSON-1317706963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0d46731b-24dd-4de4-a736-9eda896e5d2a tempest-VolumesServicesTestJSON-1317706963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0d46731b-24dd-4de4-a736-9eda896e5d2a tempest-VolumesServicesTestJSON-1317706963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:05 devstack sudo[94670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:56:05 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:06 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39a741be-98fd-4ad6-b8a6-280de493bfa3 1073741824" returned: 0 in 0.898s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39a741be-98fd-4ad6-b8a6-280de493bfa3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:06 devstack sudo[94673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39a741be-98fd-4ad6-b8a6-280de493bfa3 Jun 03 11:56:06 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:06 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0d46731b-24dd-4de4-a736-9eda896e5d2a tempest-VolumesServicesTestJSON-1317706963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.824s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-0d46731b-24dd-4de4-a736-9eda896e5d2a tempest-VolumesServicesTestJSON-1317706963 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:56:06 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-0d46731b-24dd-4de4-a736-9eda896e5d2a tempest-VolumesServicesTestJSON-1317706963 None] Deleted volume successfully. Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0d46731b-24dd-4de4-a736-9eda896e5d2a tempest-VolumesServicesTestJSON-1317706963 None] Lock "cinder-5fbd59ae-e2c3-4d17-9c78-08be7ea5cdbe-delete_volume" released by "delete_volume" :: held 2.843s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:56:06 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39a741be-98fd-4ad6-b8a6-280de493bfa3" returned: 0 in 0.721s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.494s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fdc91124-78d5-46ca-abbf-96bcc98754f4,created_at=2026-06-03T09:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-803429813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fdc91124-78d5-46ca-abbf-96bcc98754f4,host='devstack@QuobyteHD#QuobyteHD',id=2e8e3982-4f88-434f-bbb9-a7962b755ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c723860b5754be586565fb00f9436d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:56:05Z,use_quota=True,user_id='57defcafdfbc41ae93c472fc75992aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7221189-78ed-4123-b4c9-c8fd1a66ef35),volume_type_id=e7221189-78ed-4123-b4c9-c8fd1a66ef35)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Creating volume 2e8e3982-4f88-434f-bbb9-a7962b755ef4 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:56:06 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:06 devstack sudo[94677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 1073741824 Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ba1e39-318f-468d-b72b-49bb652d4a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39a741be-98fd-4ad6-b8a6-280de493bfa3', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:06 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f740c853-5b4f-4615-9a23-ceb1396c380f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:06 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Volume volume-39a741be-98fd-4ad6-b8a6-280de493bfa3 (39a741be-98fd-4ad6-b8a6-280de493bfa3): created successfully Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f740c853-5b4f-4615-9a23-ceb1396c380f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:06 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Flow 'volume_create_manager' (24430109-d442-49b9-834e-cb36b0b98cc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:56:06 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c11d9605-1596-491a-acf5-28ce2b59b64e tempest-VolumesTestJSON-2130143024 None] Created volume successfully. Jun 03 11:56:07 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 1073741824" returned: 0 in 0.906s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:07 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 Jun 03 11:56:07 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Flow 'volume_create_manager' (c843f14b-3136-41c2-8e69-6ecdfba1d69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd63b1d8-dd79-426d-b35c-5558af7a2c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd63b1d8-dd79-426d-b35c-5558af7a2c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-705434142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6110ba8a-33c5-420b-a57c-be1e1aff959a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cc507f15df3b480ea1cf6b1f22331b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:56:08Z,use_quota=True,user_id='87992c4e7d204d5ea9b7cbd6d64a968a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13bd1810-408b-42a1-a1d9-ea8624e80e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13bd1810-408b-42a1-a1d9-ea8624e80e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a140d055-3f41-4198-a053-4fb6c9cc154c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a140d055-3f41-4198-a053-4fb6c9cc154c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6110ba8a-33c5-420b-a57c-be1e1aff959a', 'volume_name': 'volume-6110ba8a-33c5-420b-a57c-be1e1aff959a', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73a7390-5f4e-4ea5-8eba-0a4f6ee25e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73a7390-5f4e-4ea5-8eba-0a4f6ee25e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a28e65a-41ad-4bda-8711-5837aaa26d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:08 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Volume 6110ba8a-33c5-420b-a57c-be1e1aff959a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6110ba8a-33c5-420b-a57c-be1e1aff959a', 'volume_size': 1} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:08 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4" returned: 0 in 0.793s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.473s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-705434142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6110ba8a-33c5-420b-a57c-be1e1aff959a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cc507f15df3b480ea1cf6b1f22331b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:56:08Z,use_quota=True,user_id='87992c4e7d204d5ea9b7cbd6d64a968a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Creating volume 6110ba8a-33c5-420b-a57c-be1e1aff959a {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:56:08 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6110ba8a-33c5-420b-a57c-be1e1aff959a 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde1bb6a-e5f1-43cb-bea0-e90d85617ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:08 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6110ba8a-33c5-420b-a57c-be1e1aff959a 1073741824 Jun 03 11:56:08 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aebe720-d8cc-4529-87e6-7df5b6fc87df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:08 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Volume volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 (2e8e3982-4f88-434f-bbb9-a7962b755ef4): created successfully Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aebe720-d8cc-4529-87e6-7df5b6fc87df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Flow 'volume_create_manager' (07306f08-863e-4792-8d8d-8936d0c02609) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:56:08 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-77de5424-46fa-4140-bbaf-9477a7314351 tempest-GroupSnapshotsTest-1791220728 None] Created volume successfully. Jun 03 11:56:09 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6110ba8a-33c5-420b-a57c-be1e1aff959a 1073741824" returned: 0 in 1.010s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6110ba8a-33c5-420b-a57c-be1e1aff959a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:09 devstack sudo[94692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6110ba8a-33c5-420b-a57c-be1e1aff959a Jun 03 11:56:09 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:10 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-228f8a38-ec78-4d1c-959d-1b3438a378a9 tempest-GroupSnapshotsTest-1791220728 None] GroupSnapshot 2d739009-7c5c-44b8-99a8-c558753b3ef8: creating. Jun 03 11:56:10 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-228f8a38-ec78-4d1c-959d-1b3438a378a9 tempest-GroupSnapshotsTest-1791220728 None] Group snapshot 2d739009-7c5c-44b8-99a8-c558753b3ef8: creating. {{(pid=86724) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 03 11:56:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-228f8a38-ec78-4d1c-959d-1b3438a378a9 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:10 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6110ba8a-33c5-420b-a57c-be1e1aff959a" returned: 0 in 0.850s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:56:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-228f8a38-ec78-4d1c-959d-1b3438a378a9 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.323s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:10 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a28e65a-41ad-4bda-8711-5837aaa26d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6110ba8a-33c5-420b-a57c-be1e1aff959a', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:10 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8f888a-ddd7-44de-9dbd-937d2d04bf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-228f8a38-ec78-4d1c-959d-1b3438a378a9 tempest-GroupSnapshotsTest-1791220728 None] Creating offline snapshot 8dc21021-6a1c-4360-bb20-bd01bbe74c3a of volume 2e8e3982-4f88-434f-bbb9-a7962b755ef4 {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 11:56:10 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Volume volume-6110ba8a-33c5-420b-a57c-be1e1aff959a (6110ba8a-33c5-420b-a57c-be1e1aff959a): created successfully Jun 03 11:56:10 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8f888a-ddd7-44de-9dbd-937d2d04bf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:10 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Flow 'volume_create_manager' (c843f14b-3136-41c2-8e69-6ecdfba1d69f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:56:10 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[beae8ab5-412c-4901-aa3d-4a0a7e44c94f]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:56:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-228f8a38-ec78-4d1c-959d-1b3438a378a9 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:10 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d483c374-e361-45a6-b92e-817dda60eb3b tempest-VolumesTestJSON-2130143024 None] Created volume successfully. Jun 03 11:56:10 devstack sudo[94695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 Jun 03 11:56:10 devstack sudo[94695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:11 devstack sudo[94695]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-228f8a38-ec78-4d1c-959d-1b3438a378a9 tempest-GroupSnapshotsTest-1791220728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4" returned: 0 in 0.882s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-228f8a38-ec78-4d1c-959d-1b3438a378a9 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:11 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a 1G Jun 03 11:56:11 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:11 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:56:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Flow 'volume_create_manager' (27a38e86-b731-4796-b943-959996a12b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:56:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37658e9-aca2-4d43-bc42-ff5d8647c743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37658e9-aca2-4d43-bc42-ff5d8647c743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1042627705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cc507f15df3b480ea1cf6b1f22331b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:56:12Z,use_quota=True,user_id='87992c4e7d204d5ea9b7cbd6d64a968a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e4f918-570c-42c6-90cb-cb58f5e76401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e4f918-570c-42c6-90cb-cb58f5e76401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda87f4d-cabd-44aa-beb7-04394086be7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda87f4d-cabd-44aa-beb7-04394086be7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb', 'volume_name': 'volume-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0af1f5b-335d-49ba-b67a-f47c55556940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0af1f5b-335d-49ba-b67a-f47c55556940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147a6256-fa3a-4f52-bc3f-c290307f9f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:11 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Volume 783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb', 'volume_size': 1} Jun 03 11:56:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:12 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-228f8a38-ec78-4d1c-959d-1b3438a378a9 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a 1G" returned: 0 in 0.966s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-228f8a38-ec78-4d1c-959d-1b3438a378a9 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:12 devstack sudo[94705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a Jun 03 11:56:12 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:12 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:56:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Flow 'volume_create_manager' (7fcedb99-c4fc-482d-a6ff-d97ae1f5df90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:56:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaac1ec6-91ee-4d1f-9fe5-cd9d3a55ab37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaac1ec6-91ee-4d1f-9fe5-cd9d3a55ab37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-178764807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ffa720-ecff-42b0-8fc8-13d5aa444946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3111751113784f6f837e118c60190235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:56:13Z,use_quota=True,user_id='96d29f27a4aa46459d2ec675bd4bb10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8cfe165-0fa6-454d-b5be-fddcce721fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8cfe165-0fa6-454d-b5be-fddcce721fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9b77a1-6711-4a32-bd37-7b23e4bf8fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9b77a1-6711-4a32-bd37-7b23e4bf8fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ffa720-ecff-42b0-8fc8-13d5aa444946', 'volume_name': 'volume-97ffa720-ecff-42b0-8fc8-13d5aa444946', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7f8778-96d8-4e48-8764-5e11239e8785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7f8778-96d8-4e48-8764-5e11239e8785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ff7cf3-591f-4d8e-9d53-8713cca77e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:12 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Volume 97ffa720-ecff-42b0-8fc8-13d5aa444946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ffa720-ecff-42b0-8fc8-13d5aa444946', 'volume_size': 1} Jun 03 11:56:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:13 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-228f8a38-ec78-4d1c-959d-1b3438a378a9 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a" returned: 0 in 0.759s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:13 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-228f8a38-ec78-4d1c-959d-1b3438a378a9 tempest-GroupSnapshotsTest-1791220728 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a is being set with open permissions: ugo+rw: NotImplementedError Jun 03 11:56:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-228f8a38-ec78-4d1c-959d-1b3438a378a9 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:13 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a Jun 03 11:56:13 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:13 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-228f8a38-ec78-4d1c-959d-1b3438a378a9 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a" returned: 0 in 0.663s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-228f8a38-ec78-4d1c-959d-1b3438a378a9 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:13 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.info Jun 03 11:56:13 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:14 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-228f8a38-ec78-4d1c-959d-1b3438a378a9 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.info" returned: 0 in 0.615s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:14 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-228f8a38-ec78-4d1c-959d-1b3438a378a9 tempest-GroupSnapshotsTest-1791220728 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.info is being set with open permissions: ugo+rw: NotImplementedError Jun 03 11:56:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-228f8a38-ec78-4d1c-959d-1b3438a378a9 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:14 devstack sudo[94717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.info Jun 03 11:56:14 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:15 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-228f8a38-ec78-4d1c-959d-1b3438a378a9 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.info" returned: 0 in 0.647s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-228f8a38-ec78-4d1c-959d-1b3438a378a9 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.650s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.229s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1042627705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cc507f15df3b480ea1cf6b1f22331b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:56:12Z,use_quota=True,user_id='87992c4e7d204d5ea9b7cbd6d64a968a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:56:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Creating volume 783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:56:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:56:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:56:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:56:15 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:56:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:15 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb 1073741824 Jun 03 11:56:15 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:15 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=99,cinder:UPDATE=123,cinder:DELETE=8,cinder:INSERT=29 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:56:15 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=102,cinder:UPDATE=130,cinder:INSERT=30,cinder:DELETE=12 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:56:15 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-228f8a38-ec78-4d1c-959d-1b3438a378a9 tempest-GroupSnapshotsTest-1791220728 None] group_snapshot 2d739009-7c5c-44b8-99a8-c558753b3ef8: created successfully Jun 03 11:56:16 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb 1073741824" returned: 0 in 0.846s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:16 devstack sudo[94726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb Jun 03 11:56:16 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:16 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb" returned: 0 in 0.673s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:16 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:56:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.743s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:16 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-178764807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ffa720-ecff-42b0-8fc8-13d5aa444946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3111751113784f6f837e118c60190235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:56:13Z,use_quota=True,user_id='96d29f27a4aa46459d2ec675bd4bb10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:56:16 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Creating volume 97ffa720-ecff-42b0-8fc8-13d5aa444946 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:56:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:16 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:56:16 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:56:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:16 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:56:16 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:56:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147a6256-fa3a-4f52-bc3f-c290307f9f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95c6a50-4e50-4e32-91ca-6a4763efa3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:16 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946 1073741824 Jun 03 11:56:16 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:16 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Volume volume-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb (783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb): created successfully Jun 03 11:56:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95c6a50-4e50-4e32-91ca-6a4763efa3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Flow 'volume_create_manager' (27a38e86-b731-4796-b943-959996a12b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:56:16 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-8518dfa9-3f5c-4246-bfe8-a88bb4336c47 tempest-VolumesTestJSON-2130143024 None] Created volume successfully. Jun 03 11:56:17 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946 1073741824" returned: 0 in 0.910s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:17 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946 Jun 03 11:56:17 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ff84daab-089e-4465-85e3-c70f5578061d tempest-VolumesTestJSON-2130143024 None] Acquiring lock "cinder-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ff84daab-089e-4465-85e3-c70f5578061d tempest-VolumesTestJSON-2130143024 None] Lock "cinder-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ff84daab-089e-4465-85e3-c70f5578061d tempest-VolumesTestJSON-2130143024 None] Acquiring lock "cinder-quobyte-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ff84daab-089e-4465-85e3-c70f5578061d tempest-VolumesTestJSON-2130143024 None] Lock "cinder-quobyte-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb" acquired by "delete_volume" :: waited 0.019s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12515be-7dd3-4bb5-a2f9-dafae2f94d24]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ff84daab-089e-4465-85e3-c70f5578061d tempest-VolumesTestJSON-2130143024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:18 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946" returned: 0 in 0.738s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.776s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "cinder-quobyte-8dc21021-6a1c-4360-bb20-bd01bbe74c3a-b32dcfc8-5769-4e60-848a-10e99425d2d7" by "_create_volume_from_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ff7cf3-591f-4d8e-9d53-8713cca77e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ffa720-ecff-42b0-8fc8-13d5aa444946', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c268686f-f83b-473d-a04b-a9bc1cd1ea53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-8dc21021-6a1c-4360-bb20-bd01bbe74c3a-b32dcfc8-5769-4e60-848a-10e99425d2d7" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Creating volume b32dcfc8-5769-4e60-848a-10e99425d2d7 from snapshot 8dc21021-6a1c-4360-bb20-bd01bbe74c3a {{(pid=86724) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "cinder-quobyte-b32dcfc8-5769-4e60-848a-10e99425d2d7" by "_copy_volume_from_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:18 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Volume volume-97ffa720-ecff-42b0-8fc8-13d5aa444946 (97ffa720-ecff-42b0-8fc8-13d5aa444946): created successfully Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c268686f-f83b-473d-a04b-a9bc1cd1ea53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Flow 'volume_create_manager' (7fcedb99-c4fc-482d-a6ff-d97ae1f5df90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:56:18 devstack sudo[94738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb Jun 03 11:56:18 devstack sudo[94738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-b32dcfc8-5769-4e60-848a-10e99425d2d7" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] snapshot: 8dc21021-6a1c-4360-bb20-bd01bbe74c3a, volume: b32dcfc8-5769-4e60-848a-10e99425d2d7, {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 11:56:18 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-f761d127-c0ae-4af2-a241-39cba9a73456 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Created volume successfully. Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a07566-1146-4a61-900f-306cf1c32cc0]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:56:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:18 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a Jun 03 11:56:18 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:19 devstack sudo[94738]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ff84daab-089e-4465-85e3-c70f5578061d tempest-VolumesTestJSON-2130143024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb" returned: 0 in 0.827s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ff84daab-089e-4465-85e3-c70f5578061d tempest-VolumesTestJSON-2130143024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:19 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb Jun 03 11:56:19 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:19 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a" returned: 0 in 0.893s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:56:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] will copy from snapshot at /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 11:56:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Creating direct copy from snapshot {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 11:56:19 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6163296d-68a9-4ef4-be21-ffe95c71a340]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:56:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-31e4ad86-c3f5-4757-8090-fd9671a192ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:19 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 Jun 03 11:56:19 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:20 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ff84daab-089e-4465-85e3-c70f5578061d tempest-VolumesTestJSON-2130143024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb" returned: 0 in 0.802s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ff84daab-089e-4465-85e3-c70f5578061d tempest-VolumesTestJSON-2130143024 None] Lock "cinder-quobyte-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb" released by "delete_volume" :: held 1.672s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:56:20 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-ff84daab-089e-4465-85e3-c70f5578061d tempest-VolumesTestJSON-2130143024 None] Created reservations ['518f86f7-9cb1-42ad-8d72-2cdd2a097a76', '7fa45381-f3ad-4d29-8541-f3349db6951b', 'f44ff9a5-63b7-416d-8e36-a5c103590e6b', '2fb7e043-4ac8-4edc-9725-86d24c4d5ec8'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:56:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ff84daab-089e-4465-85e3-c70f5578061d tempest-VolumesTestJSON-2130143024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ff84daab-089e-4465-85e3-c70f5578061d tempest-VolumesTestJSON-2130143024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ff84daab-089e-4465-85e3-c70f5578061d tempest-VolumesTestJSON-2130143024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:56:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ff84daab-089e-4465-85e3-c70f5578061d tempest-VolumesTestJSON-2130143024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:56:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ff84daab-089e-4465-85e3-c70f5578061d tempest-VolumesTestJSON-2130143024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ff84daab-089e-4465-85e3-c70f5578061d tempest-VolumesTestJSON-2130143024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:20 devstack sudo[94758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:56:20 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:20 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4" returned: 0 in 0.836s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:20 devstack cinder-volume[86724]: DEBUG cinder.utils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Path /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b32dcfc8-5769-4e60-848a-10e99425d2d7 not found in is_blk_device check {{(pid=86724) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 03 11:56:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b32dcfc8-5769-4e60-848a-10e99425d2d7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:20 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b32dcfc8-5769-4e60-848a-10e99425d2d7 Jun 03 11:56:20 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c12ce386-77e5-4f49-be51-2b60aa583d03 tempest-VolumesTestJSON-2130143024 None] Acquiring lock "cinder-6110ba8a-33c5-420b-a57c-be1e1aff959a-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c12ce386-77e5-4f49-be51-2b60aa583d03 tempest-VolumesTestJSON-2130143024 None] Lock "cinder-6110ba8a-33c5-420b-a57c-be1e1aff959a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c12ce386-77e5-4f49-be51-2b60aa583d03 tempest-VolumesTestJSON-2130143024 None] Acquiring lock "cinder-quobyte-6110ba8a-33c5-420b-a57c-be1e1aff959a" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c12ce386-77e5-4f49-be51-2b60aa583d03 tempest-VolumesTestJSON-2130143024 None] Lock "cinder-quobyte-6110ba8a-33c5-420b-a57c-be1e1aff959a" acquired by "delete_volume" :: waited 0.022s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:20 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[51425e82-4f59-4044-aae3-2b8c20c6ffd2]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:56:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c12ce386-77e5-4f49-be51-2b60aa583d03 tempest-VolumesTestJSON-2130143024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6110ba8a-33c5-420b-a57c-be1e1aff959a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:20 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6110ba8a-33c5-420b-a57c-be1e1aff959a Jun 03 11:56:20 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:20 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ff84daab-089e-4465-85e3-c70f5578061d tempest-VolumesTestJSON-2130143024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.725s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:20 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-ff84daab-089e-4465-85e3-c70f5578061d tempest-VolumesTestJSON-2130143024 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:56:20 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-ff84daab-089e-4465-85e3-c70f5578061d tempest-VolumesTestJSON-2130143024 None] Deleted volume successfully. Jun 03 11:56:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ff84daab-089e-4465-85e3-c70f5578061d tempest-VolumesTestJSON-2130143024 None] Lock "cinder-783fcfde-af1a-4eb7-b54c-aa4f18e1b5fb-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:56:22 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c12ce386-77e5-4f49-be51-2b60aa583d03 tempest-VolumesTestJSON-2130143024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6110ba8a-33c5-420b-a57c-be1e1aff959a" returned: 0 in 1.327s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c12ce386-77e5-4f49-be51-2b60aa583d03 tempest-VolumesTestJSON-2130143024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6110ba8a-33c5-420b-a57c-be1e1aff959a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:22 devstack sudo[94795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6110ba8a-33c5-420b-a57c-be1e1aff959a Jun 03 11:56:22 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:23 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c12ce386-77e5-4f49-be51-2b60aa583d03 tempest-VolumesTestJSON-2130143024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6110ba8a-33c5-420b-a57c-be1e1aff959a" returned: 0 in 1.432s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c12ce386-77e5-4f49-be51-2b60aa583d03 tempest-VolumesTestJSON-2130143024 None] Lock "cinder-quobyte-6110ba8a-33c5-420b-a57c-be1e1aff959a" released by "delete_volume" :: held 2.825s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:56:23 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-c12ce386-77e5-4f49-be51-2b60aa583d03 tempest-VolumesTestJSON-2130143024 None] Created reservations ['fc93389a-d2c2-4d48-8901-e212b4d5d35e', 'cf867eeb-04fc-4422-97e4-5ab88bcabfa9', '90cd2bd3-c395-49fb-8bce-b127e63ad899', '9d42742c-4165-4bc0-85d5-3722c53afb9f'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:56:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c12ce386-77e5-4f49-be51-2b60aa583d03 tempest-VolumesTestJSON-2130143024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c12ce386-77e5-4f49-be51-2b60aa583d03 tempest-VolumesTestJSON-2130143024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:23 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c12ce386-77e5-4f49-be51-2b60aa583d03 tempest-VolumesTestJSON-2130143024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:56:23 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c12ce386-77e5-4f49-be51-2b60aa583d03 tempest-VolumesTestJSON-2130143024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:56:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c12ce386-77e5-4f49-be51-2b60aa583d03 tempest-VolumesTestJSON-2130143024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c12ce386-77e5-4f49-be51-2b60aa583d03 tempest-VolumesTestJSON-2130143024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:23 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:56:23 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a89179b8-ef7f-4d8a-b602-e20e367f4f40 tempest-VolumesTestJSON-2130143024 None] Acquiring lock "cinder-39a741be-98fd-4ad6-b8a6-280de493bfa3-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a89179b8-ef7f-4d8a-b602-e20e367f4f40 tempest-VolumesTestJSON-2130143024 None] Lock "cinder-39a741be-98fd-4ad6-b8a6-280de493bfa3-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a89179b8-ef7f-4d8a-b602-e20e367f4f40 tempest-VolumesTestJSON-2130143024 None] Acquiring lock "cinder-quobyte-39a741be-98fd-4ad6-b8a6-280de493bfa3" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a89179b8-ef7f-4d8a-b602-e20e367f4f40 tempest-VolumesTestJSON-2130143024 None] Lock "cinder-quobyte-39a741be-98fd-4ad6-b8a6-280de493bfa3" acquired by "delete_volume" :: waited 0.048s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:24 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b44647b-14a2-47ac-8bdc-1cd74c641a73]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:56:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a89179b8-ef7f-4d8a-b602-e20e367f4f40 tempest-VolumesTestJSON-2130143024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39a741be-98fd-4ad6-b8a6-280de493bfa3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:24 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39a741be-98fd-4ad6-b8a6-280de493bfa3 Jun 03 11:56:24 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:25 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c12ce386-77e5-4f49-be51-2b60aa583d03 tempest-VolumesTestJSON-2130143024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.916s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:25 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-c12ce386-77e5-4f49-be51-2b60aa583d03 tempest-VolumesTestJSON-2130143024 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:56:25 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c12ce386-77e5-4f49-be51-2b60aa583d03 tempest-VolumesTestJSON-2130143024 None] Deleted volume successfully. Jun 03 11:56:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c12ce386-77e5-4f49-be51-2b60aa583d03 tempest-VolumesTestJSON-2130143024 None] Lock "cinder-6110ba8a-33c5-420b-a57c-be1e1aff959a-delete_volume" released by "delete_volume" :: held 5.236s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:56:26 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a89179b8-ef7f-4d8a-b602-e20e367f4f40 tempest-VolumesTestJSON-2130143024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39a741be-98fd-4ad6-b8a6-280de493bfa3" returned: 0 in 1.937s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a89179b8-ef7f-4d8a-b602-e20e367f4f40 tempest-VolumesTestJSON-2130143024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39a741be-98fd-4ad6-b8a6-280de493bfa3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:26 devstack sudo[94809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39a741be-98fd-4ad6-b8a6-280de493bfa3 Jun 03 11:56:26 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:26 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b32dcfc8-5769-4e60-848a-10e99425d2d7" returned: 0 in 6.570s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:26 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ec3d0d-d762-4922-b73c-c196d89dcc73]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:56:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:27 devstack sudo[94812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 Jun 03 11:56:27 devstack sudo[94812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:27 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a89179b8-ef7f-4d8a-b602-e20e367f4f40 tempest-VolumesTestJSON-2130143024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39a741be-98fd-4ad6-b8a6-280de493bfa3" returned: 0 in 0.878s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a89179b8-ef7f-4d8a-b602-e20e367f4f40 tempest-VolumesTestJSON-2130143024 None] Lock "cinder-quobyte-39a741be-98fd-4ad6-b8a6-280de493bfa3" released by "delete_volume" :: held 2.901s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:56:27 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-a89179b8-ef7f-4d8a-b602-e20e367f4f40 tempest-VolumesTestJSON-2130143024 None] Created reservations ['a4afcad6-7fbd-446e-9904-e31b84e142e7', '6d864a70-4fb3-4586-b37f-d4ca39a38f17', 'fb5dd098-c422-4fc5-8cc2-4d20e67ee928', '3558b1ef-0de2-48c1-8bf0-e8587621d2a3'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:56:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a89179b8-ef7f-4d8a-b602-e20e367f4f40 tempest-VolumesTestJSON-2130143024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a89179b8-ef7f-4d8a-b602-e20e367f4f40 tempest-VolumesTestJSON-2130143024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a89179b8-ef7f-4d8a-b602-e20e367f4f40 tempest-VolumesTestJSON-2130143024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:56:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a89179b8-ef7f-4d8a-b602-e20e367f4f40 tempest-VolumesTestJSON-2130143024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:56:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a89179b8-ef7f-4d8a-b602-e20e367f4f40 tempest-VolumesTestJSON-2130143024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a89179b8-ef7f-4d8a-b602-e20e367f4f40 tempest-VolumesTestJSON-2130143024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:27 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:56:27 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:28 devstack sudo[94812]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4" returned: 0 in 1.098s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:28 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Image conversion details: src /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4, size 1024.00 MB, duration 6.57 sec, destination /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b32dcfc8-5769-4e60-848a-10e99425d2d7 {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 11:56:28 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Converted 1024.00 MB image at 155.78 MB/s Jun 03 11:56:28 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b32dcfc8-5769-4e60-848a-10e99425d2d7 is being set with open permissions: ugo+rw: NotImplementedError Jun 03 11:56:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b32dcfc8-5769-4e60-848a-10e99425d2d7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:28 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b32dcfc8-5769-4e60-848a-10e99425d2d7 Jun 03 11:56:28 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:28 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a89179b8-ef7f-4d8a-b602-e20e367f4f40 tempest-VolumesTestJSON-2130143024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.650s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:28 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-a89179b8-ef7f-4d8a-b602-e20e367f4f40 tempest-VolumesTestJSON-2130143024 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:56:28 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a89179b8-ef7f-4d8a-b602-e20e367f4f40 tempest-VolumesTestJSON-2130143024 None] Deleted volume successfully. Jun 03 11:56:28 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a89179b8-ef7f-4d8a-b602-e20e367f4f40 tempest-VolumesTestJSON-2130143024 None] Lock "cinder-39a741be-98fd-4ad6-b8a6-280de493bfa3-delete_volume" released by "delete_volume" :: held 3.873s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:56:28 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b32dcfc8-5769-4e60-848a-10e99425d2d7" returned: 0 in 0.738s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:28 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-b32dcfc8-5769-4e60-848a-10e99425d2d7" released by "_copy_volume_from_snapshot" :: held 10.266s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:56:28 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-8dc21021-6a1c-4360-bb20-bd01bbe74c3a-b32dcfc8-5769-4e60-848a-10e99425d2d7" released by "_create_volume_from_snapshot" :: held 10.310s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:56:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.348s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-31e4ad86-c3f5-4757-8090-fd9671a192ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.179s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:28 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-31e4ad86-c3f5-4757-8090-fd9671a192ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Creating offline snapshot 6a387997-fbbb-40d7-9192-5da5a86034f0 of volume 97ffa720-ecff-42b0-8fc8-13d5aa444946 {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 11:56:28 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b50be30-dc38-48b0-85eb-c303ab4f1f0f]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:56:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-31e4ad86-c3f5-4757-8090-fd9671a192ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:28 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a49e10d2-d097-4635-a28d-fa41508bc534 tempest-GroupSnapshotsTest-1791220728 None] Create group from source-snapshot-2d739009-7c5c-44b8-99a8-c558753b3ef8 completed successfully. Jun 03 11:56:29 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946 Jun 03 11:56:29 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:29 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-31e4ad86-c3f5-4757-8090-fd9671a192ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946" returned: 0 in 0.859s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-31e4ad86-c3f5-4757-8090-fd9671a192ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.6a387997-fbbb-40d7-9192-5da5a86034f0 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:29 devstack sudo[94845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.6a387997-fbbb-40d7-9192-5da5a86034f0 1G Jun 03 11:56:29 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4aabfe7c-583d-4311-984b-37e7dfc18d99 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "cinder-quobyte-b32dcfc8-5769-4e60-848a-10e99425d2d7" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4aabfe7c-583d-4311-984b-37e7dfc18d99 tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-b32dcfc8-5769-4e60-848a-10e99425d2d7" acquired by "delete_volume" :: waited 0.019s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:30 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0c69b8-76a9-4711-b308-dab23ba9dd6c]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:56:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4aabfe7c-583d-4311-984b-37e7dfc18d99 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b32dcfc8-5769-4e60-848a-10e99425d2d7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:30 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b32dcfc8-5769-4e60-848a-10e99425d2d7 Jun 03 11:56:30 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:30 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-31e4ad86-c3f5-4757-8090-fd9671a192ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.6a387997-fbbb-40d7-9192-5da5a86034f0 1G" returned: 0 in 0.906s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-31e4ad86-c3f5-4757-8090-fd9671a192ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ffa720-ecff-42b0-8fc8-13d5aa444946 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.6a387997-fbbb-40d7-9192-5da5a86034f0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:30 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ffa720-ecff-42b0-8fc8-13d5aa444946 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.6a387997-fbbb-40d7-9192-5da5a86034f0 Jun 03 11:56:30 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:31 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4aabfe7c-583d-4311-984b-37e7dfc18d99 tempest-GroupSnapshotsTest-1791220728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b32dcfc8-5769-4e60-848a-10e99425d2d7" returned: 0 in 0.846s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4aabfe7c-583d-4311-984b-37e7dfc18d99 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b32dcfc8-5769-4e60-848a-10e99425d2d7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:31 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b32dcfc8-5769-4e60-848a-10e99425d2d7 Jun 03 11:56:31 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:31 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-31e4ad86-c3f5-4757-8090-fd9671a192ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ffa720-ecff-42b0-8fc8-13d5aa444946 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.6a387997-fbbb-40d7-9192-5da5a86034f0" returned: 0 in 0.801s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:31 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-31e4ad86-c3f5-4757-8090-fd9671a192ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.6a387997-fbbb-40d7-9192-5da5a86034f0 is being set with open permissions: ugo+rw Jun 03 11:56:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-31e4ad86-c3f5-4757-8090-fd9671a192ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.6a387997-fbbb-40d7-9192-5da5a86034f0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:31 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.6a387997-fbbb-40d7-9192-5da5a86034f0 Jun 03 11:56:31 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:32 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4aabfe7c-583d-4311-984b-37e7dfc18d99 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b32dcfc8-5769-4e60-848a-10e99425d2d7" returned: 0 in 0.685s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4aabfe7c-583d-4311-984b-37e7dfc18d99 tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-b32dcfc8-5769-4e60-848a-10e99425d2d7" released by "delete_volume" :: held 1.582s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:56:32 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-31e4ad86-c3f5-4757-8090-fd9671a192ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.6a387997-fbbb-40d7-9192-5da5a86034f0" returned: 0 in 0.628s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-4aabfe7c-583d-4311-984b-37e7dfc18d99 tempest-GroupSnapshotsTest-1791220728 None] Created reservations ['28118043-e82d-4be0-8646-c56c3d60064b'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-31e4ad86-c3f5-4757-8090-fd9671a192ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:32 devstack cinder-volume[86724]: WARNING cinder.quota [None req-4aabfe7c-583d-4311-984b-37e7dfc18d99 tempest-GroupSnapshotsTest-1791220728 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-754774965 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-754774965, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:56:32 devstack cinder-volume[86724]: WARNING cinder.quota [None req-4aabfe7c-583d-4311-984b-37e7dfc18d99 tempest-GroupSnapshotsTest-1791220728 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-754774965 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-754774965, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:56:32 devstack sudo[94868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.info Jun 03 11:56:32 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-4aabfe7c-583d-4311-984b-37e7dfc18d99 tempest-GroupSnapshotsTest-1791220728 None] Created reservations ['9d09e8cb-60a8-42f2-9690-75321bab8151', 'ca40cfc6-f3f6-4803-b7b8-be8c793f7629', 'acde3b34-284b-4445-b925-edd9eb273bba', 'e912ea65-d254-4dc0-aff6-bc4454a25e15'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4aabfe7c-583d-4311-984b-37e7dfc18d99 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4aabfe7c-583d-4311-984b-37e7dfc18d99 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4aabfe7c-583d-4311-984b-37e7dfc18d99 tempest-GroupSnapshotsTest-1791220728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4aabfe7c-583d-4311-984b-37e7dfc18d99 tempest-GroupSnapshotsTest-1791220728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4aabfe7c-583d-4311-984b-37e7dfc18d99 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4aabfe7c-583d-4311-984b-37e7dfc18d99 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:32 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:56:32 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:32 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] group_snapshot 2d739009-7c5c-44b8-99a8-c558753b3ef8: deleting Jun 03 11:56:32 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-31e4ad86-c3f5-4757-8090-fd9671a192ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.info" returned: 0 in 0.661s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:32 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-31e4ad86-c3f5-4757-8090-fd9671a192ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.info is being set with open permissions: ugo+rw Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-31e4ad86-c3f5-4757-8090-fd9671a192ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] group_snapshot 2d739009-7c5c-44b8-99a8-c558753b3ef8: deleting {{(pid=86724) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 03 11:56:32 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.info Jun 03 11:56:32 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "cinder-quobyte-2e8e3982-4f88-434f-bbb9-a7962b755ef4" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-2e8e3982-4f88-434f-bbb9-a7962b755ef4" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "cinder-quobyte-8dc21021-6a1c-4360-bb20-bd01bbe74c3a" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-8dc21021-6a1c-4360-bb20-bd01bbe74c3a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] Deleting offline snapshot 8dc21021-6a1c-4360-bb20-bd01bbe74c3a of volume 2e8e3982-4f88-434f-bbb9-a7962b755ef4 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] snapshot_file for this snap is: volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[532492b8-6732-424d-a374-a3a1937bd735]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:32 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4aabfe7c-583d-4311-984b-37e7dfc18d99 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.674s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:32 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-4aabfe7c-583d-4311-984b-37e7dfc18d99 tempest-GroupSnapshotsTest-1791220728 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:56:32 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-4aabfe7c-583d-4311-984b-37e7dfc18d99 tempest-GroupSnapshotsTest-1791220728 None] Delete group completed successfully. Jun 03 11:56:33 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f8fa0ba5-3cd6-426f-b0b7-3302a02e0ebc tempest-BackendsCapabilitiesAdminTestsJSON-1190994827 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7015228271484, 'free_capacity_gb': 1775.7015228271484, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86724) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 03 11:56:33 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a Jun 03 11:56:33 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:33 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-31e4ad86-c3f5-4757-8090-fd9671a192ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.info" returned: 0 in 0.604s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-31e4ad86-c3f5-4757-8090-fd9671a192ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.628s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:33 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-31e4ad86-c3f5-4757-8090-fd9671a192ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Create snapshot completed successfully Jun 03 11:56:33 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bf915b87-c6aa-4bc7-98ba-ae694852b111 tempest-BackendsCapabilitiesAdminTestsJSON-1190994827 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7015228271484, 'free_capacity_gb': 1775.7015228271484, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86724) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 03 11:56:33 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a" returned: 0 in 0.840s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:33 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:56:33 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1feb52f7-e3be-4078-8f69-87173098bafb]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:56:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:33 devstack sudo[94886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 Jun 03 11:56:33 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Acquiring lock "cinder-6a387997-fbbb-40d7-9192-5da5a86034f0-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Lock "cinder-6a387997-fbbb-40d7-9192-5da5a86034f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Acquiring lock "cinder-quobyte-97ffa720-ecff-42b0-8fc8-13d5aa444946" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Lock "cinder-quobyte-97ffa720-ecff-42b0-8fc8-13d5aa444946" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Acquiring lock "cinder-quobyte-6a387997-fbbb-40d7-9192-5da5a86034f0" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Lock "cinder-quobyte-6a387997-fbbb-40d7-9192-5da5a86034f0" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:34 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Deleting offline snapshot 6a387997-fbbb-40d7-9192-5da5a86034f0 of volume 97ffa720-ecff-42b0-8fc8-13d5aa444946 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 11:56:34 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] snapshot_file for this snap is: volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.6a387997-fbbb-40d7-9192-5da5a86034f0 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 11:56:34 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08b5a21-4349-4d6a-ac40-4ef49a0b375a]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:56:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.6a387997-fbbb-40d7-9192-5da5a86034f0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:34 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.6a387997-fbbb-40d7-9192-5da5a86034f0 Jun 03 11:56:34 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:35 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4" returned: 0 in 1.673s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:35 devstack sudo[94959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a Jun 03 11:56:35 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:35 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.6a387997-fbbb-40d7-9192-5da5a86034f0" returned: 0 in 1.377s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:35 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ffa720-ecff-42b0-8fc8-13d5aa444946(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:56:35 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f6e612-ce6e-45c8-a045-dd43254043e9]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:56:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:35 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946 Jun 03 11:56:35 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:36 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a" returned: 0 in 1.216s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 11:56:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:36 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a Jun 03 11:56:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:56:36 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:56:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:36 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:56:36 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:37 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946" returned: 0 in 1.438s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.6a387997-fbbb-40d7-9192-5da5a86034f0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:37 devstack sudo[94976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.6a387997-fbbb-40d7-9192-5da5a86034f0 Jun 03 11:56:37 devstack sudo[94976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:37 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.128s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:38 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:56:38 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:38 devstack sudo[94976]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.6a387997-fbbb-40d7-9192-5da5a86034f0" returned: 0 in 1.138s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.6a387997-fbbb-40d7-9192-5da5a86034f0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4.8dc21021-6a1c-4360-bb20-bd01bbe74c3a" returned: 0 in 1.524s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:38 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.6a387997-fbbb-40d7-9192-5da5a86034f0 Jun 03 11:56:38 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:38 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-8dc21021-6a1c-4360-bb20-bd01bbe74c3a" released by "_delete_snapshot" :: held 5.404s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:56:38 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-2e8e3982-4f88-434f-bbb9-a7962b755ef4" released by "delete_snapshot" :: held 5.442s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:56:38 devstack cinder-volume[86724]: WARNING cinder.quota [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-754774965 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-754774965, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:56:38 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] Created reservations ['469e1db7-b6f3-4517-9922-fb6fee31303c', 'e6acfbc7-49d9-4a80-947b-68119f85c4fd', '0ac1956b-f330-4cd6-8b54-12334a7dad55', 'f6f403d1-6e48-480f-a594-0eaabfcda667'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:56:38 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-3de698e1-a2bf-4544-a603-6d1bff3965df tempest-GroupSnapshotsTest-1791220728 None] group_snapshot 2d739009-7c5c-44b8-99a8-c558753b3ef8: deleted successfully Jun 03 11:56:39 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946.6a387997-fbbb-40d7-9192-5da5a86034f0" returned: 0 in 0.913s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Lock "cinder-quobyte-6a387997-fbbb-40d7-9192-5da5a86034f0" released by "_delete_snapshot" :: held 5.078s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:56:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Lock "cinder-quobyte-97ffa720-ecff-42b0-8fc8-13d5aa444946" released by "delete_snapshot" :: held 5.118s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:56:39 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Created reservations ['50c7478b-2cb1-47fc-a7c1-01a54028b4fe', '9b945fae-8d5e-4e47-a8ef-610d7db3e5b6', 'ae6522c8-4f93-4a73-9bf2-c2d7e41ae7d7', '4c8347d9-0128-47f8-b04b-d8ca189dbda7'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:56:39 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Delete snapshot completed successfully. Jun 03 11:56:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-bcbd8636-51ca-47e4-914d-c651eae00ff1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Lock "cinder-6a387997-fbbb-40d7-9192-5da5a86034f0-delete_snapshot" released by "delete_snapshot" :: held 5.307s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:56:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e1a677b3-5eab-4b2a-b0c2-f34b9fb3a5f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Acquiring lock "cinder-97ffa720-ecff-42b0-8fc8-13d5aa444946-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e1a677b3-5eab-4b2a-b0c2-f34b9fb3a5f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Lock "cinder-97ffa720-ecff-42b0-8fc8-13d5aa444946-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ca48e1f1-8fe1-4708-9301-8007a5d2dc17 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "cinder-quobyte-2e8e3982-4f88-434f-bbb9-a7962b755ef4" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:40 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ca48e1f1-8fe1-4708-9301-8007a5d2dc17 tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-2e8e3982-4f88-434f-bbb9-a7962b755ef4" acquired by "delete_volume" :: waited 0.035s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:40 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e1a677b3-5eab-4b2a-b0c2-f34b9fb3a5f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Acquiring lock "cinder-quobyte-97ffa720-ecff-42b0-8fc8-13d5aa444946" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:40 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c656362-08b7-49bf-aa6f-42dddf218d4d]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:56:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ca48e1f1-8fe1-4708-9301-8007a5d2dc17 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:40 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e1a677b3-5eab-4b2a-b0c2-f34b9fb3a5f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Lock "cinder-quobyte-97ffa720-ecff-42b0-8fc8-13d5aa444946" acquired by "delete_volume" :: waited 0.049s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:40 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1423c4dd-1289-44d3-b751-6f6b270c784f]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:56:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e1a677b3-5eab-4b2a-b0c2-f34b9fb3a5f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:40 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 Jun 03 11:56:40 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:40 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946 Jun 03 11:56:40 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:41 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ca48e1f1-8fe1-4708-9301-8007a5d2dc17 tempest-GroupSnapshotsTest-1791220728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4" returned: 0 in 1.045s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ca48e1f1-8fe1-4708-9301-8007a5d2dc17 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:41 devstack sudo[95000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4 Jun 03 11:56:41 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:41 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e1a677b3-5eab-4b2a-b0c2-f34b9fb3a5f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946" returned: 0 in 1.079s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e1a677b3-5eab-4b2a-b0c2-f34b9fb3a5f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:41 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946 Jun 03 11:56:41 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:42 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e1a677b3-5eab-4b2a-b0c2-f34b9fb3a5f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97ffa720-ecff-42b0-8fc8-13d5aa444946" returned: 0 in 0.816s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:42 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ca48e1f1-8fe1-4708-9301-8007a5d2dc17 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2e8e3982-4f88-434f-bbb9-a7962b755ef4" returned: 0 in 0.994s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e1a677b3-5eab-4b2a-b0c2-f34b9fb3a5f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Lock "cinder-quobyte-97ffa720-ecff-42b0-8fc8-13d5aa444946" released by "delete_volume" :: held 2.030s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ca48e1f1-8fe1-4708-9301-8007a5d2dc17 tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-2e8e3982-4f88-434f-bbb9-a7962b755ef4" released by "delete_volume" :: held 2.141s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-ca48e1f1-8fe1-4708-9301-8007a5d2dc17 tempest-GroupSnapshotsTest-1791220728 None] Created reservations ['a4870073-0116-4a83-8b94-f139cdfce3a0'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-e1a677b3-5eab-4b2a-b0c2-f34b9fb3a5f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Created reservations ['c252f051-7da2-45ba-a670-1046439eb9f4', '4146a0e2-75eb-45ee-8df5-78d5b8e9cdb6', 'a04d5c55-1cda-40b6-b1de-1507b0a6a484', 'b14070b7-0f6a-4810-8b58-0dcb2c8c4502'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:56:42 devstack cinder-volume[86724]: WARNING cinder.db.sqlalchemy.api [None req-ca48e1f1-8fe1-4708-9301-8007a5d2dc17 tempest-GroupSnapshotsTest-1791220728 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-754774965'] Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-ca48e1f1-8fe1-4708-9301-8007a5d2dc17 tempest-GroupSnapshotsTest-1791220728 None] Created reservations ['6c82912e-0547-4183-9310-7f8fd2e37a17', 'd3717a05-cec0-4827-bebf-2e936ee25267', '6099aa6b-b8fb-4dfc-b428-ecabdb0f5031', 'e43466a6-53a3-4ce4-92de-d420a3f584ec'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Flow 'volume_create_manager' (b2a5d5e8-96f3-4ff7-8d44-6def91c4c6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aaa99ad-b41f-4d47-be46-34f225b627cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e1a677b3-5eab-4b2a-b0c2-f34b9fb3a5f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e1a677b3-5eab-4b2a-b0c2-f34b9fb3a5f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e1a677b3-5eab-4b2a-b0c2-f34b9fb3a5f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e1a677b3-5eab-4b2a-b0c2-f34b9fb3a5f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e1a677b3-5eab-4b2a-b0c2-f34b9fb3a5f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e1a677b3-5eab-4b2a-b0c2-f34b9fb3a5f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:42 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:56:42 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aaa99ad-b41f-4d47-be46-34f225b627cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-65897940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e822c36-a896-4fc3-83b3-95dc2dd8915b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3829f65dc64f49dd91dff183cb433030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:56:42Z,use_quota=True,user_id='5d7ef179870c4fde9ea40f8be331b534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a122c233-b70f-4312-b735-5b9e931563c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a122c233-b70f-4312-b735-5b9e931563c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a5c9db9-040c-403a-b3ce-91ab20bae010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a5c9db9-040c-403a-b3ce-91ab20bae010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e822c36-a896-4fc3-83b3-95dc2dd8915b', 'volume_name': 'volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee17a7ad-3d05-46a4-909e-ca6ad5de903a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee17a7ad-3d05-46a4-909e-ca6ad5de903a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1349115-4e55-4176-9273-4f28e3b0e3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:42 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Volume 6e822c36-a896-4fc3-83b3-95dc2dd8915b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b', 'volume_size': 1} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-65897940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e822c36-a896-4fc3-83b3-95dc2dd8915b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3829f65dc64f49dd91dff183cb433030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:56:42Z,use_quota=True,user_id='5d7ef179870c4fde9ea40f8be331b534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Creating volume 6e822c36-a896-4fc3-83b3-95dc2dd8915b {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:56:42 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:42 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b 1073741824 Jun 03 11:56:42 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ca48e1f1-8fe1-4708-9301-8007a5d2dc17 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ca48e1f1-8fe1-4708-9301-8007a5d2dc17 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ca48e1f1-8fe1-4708-9301-8007a5d2dc17 tempest-GroupSnapshotsTest-1791220728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ca48e1f1-8fe1-4708-9301-8007a5d2dc17 tempest-GroupSnapshotsTest-1791220728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ca48e1f1-8fe1-4708-9301-8007a5d2dc17 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ca48e1f1-8fe1-4708-9301-8007a5d2dc17 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:42 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:56:42 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:43 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e1a677b3-5eab-4b2a-b0c2-f34b9fb3a5f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.672s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:43 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-e1a677b3-5eab-4b2a-b0c2-f34b9fb3a5f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:56:43 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-e1a677b3-5eab-4b2a-b0c2-f34b9fb3a5f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Deleted volume successfully. Jun 03 11:56:43 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e1a677b3-5eab-4b2a-b0c2-f34b9fb3a5f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893658751 None] Lock "cinder-97ffa720-ecff-42b0-8fc8-13d5aa444946-delete_volume" released by "delete_volume" :: held 3.306s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:56:43 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ca48e1f1-8fe1-4708-9301-8007a5d2dc17 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.776s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:43 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-ca48e1f1-8fe1-4708-9301-8007a5d2dc17 tempest-GroupSnapshotsTest-1791220728 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:56:43 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-ca48e1f1-8fe1-4708-9301-8007a5d2dc17 tempest-GroupSnapshotsTest-1791220728 None] Delete group completed successfully. Jun 03 11:56:43 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b 1073741824" returned: 0 in 1.224s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:43 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b Jun 03 11:56:43 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:44 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d0082b12-01b7-45ec-847a-bb9171279cf4 tempest-GroupSnapshotsTest-1791220728 None] Group tempest-GroupSnapshotsTest-Group-774268009: creating Jun 03 11:56:44 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d0082b12-01b7-45ec-847a-bb9171279cf4 tempest-GroupSnapshotsTest-1791220728 None] Group tempest-GroupSnapshotsTest-Group-774268009: created successfully Jun 03 11:56:44 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d0082b12-01b7-45ec-847a-bb9171279cf4 tempest-GroupSnapshotsTest-1791220728 None] Create group completed successfully. Jun 03 11:56:44 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b" returned: 0 in 0.766s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:44 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:56:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:44 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1349115-4e55-4176-9273-4f28e3b0e3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:44 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58f5ca5-7a2e-49c6-b307-c2cb60bb92cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:44 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Volume volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b (6e822c36-a896-4fc3-83b3-95dc2dd8915b): created successfully Jun 03 11:56:44 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58f5ca5-7a2e-49c6-b307-c2cb60bb92cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:44 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Flow 'volume_create_manager' (b2a5d5e8-96f3-4ff7-8d44-6def91c4c6b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:56:44 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-cfc6080e-69d5-4662-9715-929791d70f5b tempest-SnapshotsActionsTest-893138396 None] Created volume successfully. Jun 03 11:56:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-51f555c5-fdb4-47cf-9a28-266e230f49a7 tempest-SnapshotsActionsTest-893138396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-51f555c5-fdb4-47cf-9a28-266e230f49a7 tempest-SnapshotsActionsTest-893138396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:46 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-51f555c5-fdb4-47cf-9a28-266e230f49a7 tempest-SnapshotsActionsTest-893138396 None] Creating offline snapshot 3fdafb90-deb1-46d4-b28d-0a95553ba3fb of volume 6e822c36-a896-4fc3-83b3-95dc2dd8915b {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 11:56:46 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e333c56-6894-489d-a135-1ce1fc3c7557]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:56:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-51f555c5-fdb4-47cf-9a28-266e230f49a7 tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:46 devstack sudo[95023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b Jun 03 11:56:46 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:46 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:56:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Flow 'volume_create_manager' (e4e33290-9866-453a-b302-c9bd9f34dfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:56:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078b1022-df92-4019-8bcd-b6d294c87eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078b1022-df92-4019-8bcd-b6d294c87eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1735895020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4c716a12-5474-42f5-8e9c-a1fc912fac93,host='devstack@QuobyteHD#QuobyteHD',id=e43b92ce-de79-420a-bdff-cfbbd9378f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c723860b5754be586565fb00f9436d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:56:47Z,use_quota=True,user_id='57defcafdfbc41ae93c472fc75992aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3316d898-bc48-4251-8260-8a1eb4f50d1e),volume_type_id=3316d898-bc48-4251-8260-8a1eb4f50d1e)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3381201-5dcd-46a4-9396-c8e37f667353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3381201-5dcd-46a4-9396-c8e37f667353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb0e122-0ba1-4e8f-9e48-4f96595b726d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb0e122-0ba1-4e8f-9e48-4f96595b726d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e43b92ce-de79-420a-bdff-cfbbd9378f7c', 'volume_name': 'volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e5ddb7-9c05-4bc5-bd7e-3c9ef03f18ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e5ddb7-9c05-4bc5-bd7e-3c9ef03f18ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781f8f47-6309-4c6b-b3b1-c797d8d9c1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:46 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Volume e43b92ce-de79-420a-bdff-cfbbd9378f7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c', 'volume_size': 1} Jun 03 11:56:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:47 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-51f555c5-fdb4-47cf-9a28-266e230f49a7 tempest-SnapshotsActionsTest-893138396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b" returned: 0 in 1.400s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-51f555c5-fdb4-47cf-9a28-266e230f49a7 tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:47 devstack sudo[95039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb 1G Jun 03 11:56:47 devstack sudo[95039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:48 devstack sudo[95039]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-51f555c5-fdb4-47cf-9a28-266e230f49a7 tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb 1G" returned: 0 in 1.201s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-51f555c5-fdb4-47cf-9a28-266e230f49a7 tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:48 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb Jun 03 11:56:48 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:49 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-51f555c5-fdb4-47cf-9a28-266e230f49a7 tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb" returned: 0 in 0.709s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:49 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-51f555c5-fdb4-47cf-9a28-266e230f49a7 tempest-SnapshotsActionsTest-893138396 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb is being set with open permissions: ugo+rw Jun 03 11:56:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-51f555c5-fdb4-47cf-9a28-266e230f49a7 tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:49 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb Jun 03 11:56:49 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:50 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-51f555c5-fdb4-47cf-9a28-266e230f49a7 tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb" returned: 0 in 0.622s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-51f555c5-fdb4-47cf-9a28-266e230f49a7 tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:50 devstack sudo[95084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.info Jun 03 11:56:50 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:50 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-51f555c5-fdb4-47cf-9a28-266e230f49a7 tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.info" returned: 0 in 0.762s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:50 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-51f555c5-fdb4-47cf-9a28-266e230f49a7 tempest-SnapshotsActionsTest-893138396 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.info is being set with open permissions: ugo+rw Jun 03 11:56:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-51f555c5-fdb4-47cf-9a28-266e230f49a7 tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:50 devstack sudo[95129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.info Jun 03 11:56:51 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:51 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-51f555c5-fdb4-47cf-9a28-266e230f49a7 tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.info" returned: 0 in 0.618s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-51f555c5-fdb4-47cf-9a28-266e230f49a7 tempest-SnapshotsActionsTest-893138396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.452s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.870s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4c716a12-5474-42f5-8e9c-a1fc912fac93,created_at=2026-06-03T09:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1735895020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4c716a12-5474-42f5-8e9c-a1fc912fac93,host='devstack@QuobyteHD#QuobyteHD',id=e43b92ce-de79-420a-bdff-cfbbd9378f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c723860b5754be586565fb00f9436d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:56:47Z,use_quota=True,user_id='57defcafdfbc41ae93c472fc75992aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3316d898-bc48-4251-8260-8a1eb4f50d1e),volume_type_id=3316d898-bc48-4251-8260-8a1eb4f50d1e)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:56:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Creating volume e43b92ce-de79-420a-bdff-cfbbd9378f7c {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:56:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:56:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:56:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:56:51 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:56:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:51 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c 1073741824 Jun 03 11:56:51 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:51 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-51f555c5-fdb4-47cf-9a28-266e230f49a7 tempest-SnapshotsActionsTest-893138396 None] Create snapshot completed successfully Jun 03 11:56:52 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c 1073741824" returned: 0 in 0.880s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:52 devstack sudo[95142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c Jun 03 11:56:52 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:53 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c" returned: 0 in 0.720s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:53 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:56:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:53 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781f8f47-6309-4c6b-b3b1-c797d8d9c1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:53 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44e061e-66c9-4036-80d6-0106d7ca0149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:53 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Volume volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c (e43b92ce-de79-420a-bdff-cfbbd9378f7c): created successfully Jun 03 11:56:53 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44e061e-66c9-4036-80d6-0106d7ca0149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:53 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Flow 'volume_create_manager' (e4e33290-9866-453a-b302-c9bd9f34dfc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:56:53 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-0d18fdfb-18a6-4a76-8d24-dac9b085b4f0 tempest-GroupSnapshotsTest-1791220728 None] Created volume successfully. Jun 03 11:56:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8e3b0934-be64-4132-9652-a0874591cf41 tempest-SnapshotsActionsTest-893138396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8e3b0934-be64-4132-9652-a0874591cf41 tempest-SnapshotsActionsTest-893138396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:53 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-8e3b0934-be64-4132-9652-a0874591cf41 tempest-SnapshotsActionsTest-893138396 None] Creating offline snapshot 63ec5b7a-1423-487b-bb5c-0652646652c1 of volume 6e822c36-a896-4fc3-83b3-95dc2dd8915b {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 11:56:53 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd490600-aaa7-456a-8496-58d8c7922708]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:56:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8e3b0934-be64-4132-9652-a0874591cf41 tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:53 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb Jun 03 11:56:53 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:54 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8e3b0934-be64-4132-9652-a0874591cf41 tempest-SnapshotsActionsTest-893138396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb" returned: 0 in 1.176s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:54 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-8e3b0934-be64-4132-9652-a0874591cf41 tempest-SnapshotsActionsTest-893138396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:56:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8e3b0934-be64-4132-9652-a0874591cf41 tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.63ec5b7a-1423-487b-bb5c-0652646652c1 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:54 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.63ec5b7a-1423-487b-bb5c-0652646652c1 1G Jun 03 11:56:54 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:55 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:56:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Flow 'volume_create_manager' (0fe9531d-bb2a-42ca-8e2a-41b7d03472eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:56:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d806ef-4744-4eb8-92be-d2481ed21315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d806ef-4744-4eb8-92be-d2481ed21315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1794069247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4c716a12-5474-42f5-8e9c-a1fc912fac93,host='devstack@QuobyteHD#QuobyteHD',id=fd68a82a-2188-43a0-b0ac-b5169174bf76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c723860b5754be586565fb00f9436d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:56:55Z,use_quota=True,user_id='57defcafdfbc41ae93c472fc75992aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3316d898-bc48-4251-8260-8a1eb4f50d1e),volume_type_id=3316d898-bc48-4251-8260-8a1eb4f50d1e)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f26da0c7-9309-4416-b790-e31725d3cd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f26da0c7-9309-4416-b790-e31725d3cd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c76ae35-3a2f-407a-8f6c-ac100e09e821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c76ae35-3a2f-407a-8f6c-ac100e09e821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd68a82a-2188-43a0-b0ac-b5169174bf76', 'volume_name': 'volume-fd68a82a-2188-43a0-b0ac-b5169174bf76', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968ce58f-c9a6-4390-879c-59dffde22e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968ce58f-c9a6-4390-879c-59dffde22e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:56:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be2de9f-7a9d-4d3a-9bc4-38ad745ce758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:56:55 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Volume fd68a82a-2188-43a0-b0ac-b5169174bf76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd68a82a-2188-43a0-b0ac-b5169174bf76', 'volume_size': 1} Jun 03 11:56:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:56 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8e3b0934-be64-4132-9652-a0874591cf41 tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.63ec5b7a-1423-487b-bb5c-0652646652c1 1G" returned: 0 in 1.657s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8e3b0934-be64-4132-9652-a0874591cf41 tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.63ec5b7a-1423-487b-bb5c-0652646652c1 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:56 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.63ec5b7a-1423-487b-bb5c-0652646652c1 Jun 03 11:56:56 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:57 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8e3b0934-be64-4132-9652-a0874591cf41 tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.63ec5b7a-1423-487b-bb5c-0652646652c1" returned: 0 in 1.034s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:57 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-8e3b0934-be64-4132-9652-a0874591cf41 tempest-SnapshotsActionsTest-893138396 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.63ec5b7a-1423-487b-bb5c-0652646652c1 is being set with open permissions: ugo+rw Jun 03 11:56:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8e3b0934-be64-4132-9652-a0874591cf41 tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.63ec5b7a-1423-487b-bb5c-0652646652c1 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:57 devstack sudo[95201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.63ec5b7a-1423-487b-bb5c-0652646652c1 Jun 03 11:56:57 devstack sudo[95201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:58 devstack sudo[95201]: pam_unix(sudo:session): session closed for user root Jun 03 11:56:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8e3b0934-be64-4132-9652-a0874591cf41 tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.63ec5b7a-1423-487b-bb5c-0652646652c1" returned: 0 in 1.069s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:56:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8e3b0934-be64-4132-9652-a0874591cf41 tempest-SnapshotsActionsTest-893138396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.068s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.989s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:58 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4c716a12-5474-42f5-8e9c-a1fc912fac93,created_at=2026-06-03T09:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1794069247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4c716a12-5474-42f5-8e9c-a1fc912fac93,host='devstack@QuobyteHD#QuobyteHD',id=fd68a82a-2188-43a0-b0ac-b5169174bf76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c723860b5754be586565fb00f9436d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:56:55Z,use_quota=True,user_id='57defcafdfbc41ae93c472fc75992aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3316d898-bc48-4251-8260-8a1eb4f50d1e),volume_type_id=3316d898-bc48-4251-8260-8a1eb4f50d1e)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:56:58 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Creating volume fd68a82a-2188-43a0-b0ac-b5169174bf76 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:56:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:56:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:56:58 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:56:58 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:56:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:56:58 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:56:58 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:56:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:58 devstack sudo[95204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76 1073741824 Jun 03 11:56:58 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:56:58 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-8e3b0934-be64-4132-9652-a0874591cf41 tempest-SnapshotsActionsTest-893138396 None] Create snapshot completed successfully Jun 03 11:56:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] Acquiring lock "cinder-63ec5b7a-1423-487b-bb5c-0652646652c1-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-63ec5b7a-1423-487b-bb5c-0652646652c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] Acquiring lock "cinder-quobyte-6e822c36-a896-4fc3-83b3-95dc2dd8915b" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-quobyte-6e822c36-a896-4fc3-83b3-95dc2dd8915b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] Acquiring lock "cinder-quobyte-63ec5b7a-1423-487b-bb5c-0652646652c1" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:56:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-quobyte-63ec5b7a-1423-487b-bb5c-0652646652c1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:56:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] Deleting offline snapshot 63ec5b7a-1423-487b-bb5c-0652646652c1 of volume 6e822c36-a896-4fc3-83b3-95dc2dd8915b {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 11:56:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] snapshot_file for this snap is: volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.63ec5b7a-1423-487b-bb5c-0652646652c1 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 11:56:59 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2e48ca-926a-451c-9570-d217270bb506]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:56:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.63ec5b7a-1423-487b-bb5c-0652646652c1 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:56:59 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.63ec5b7a-1423-487b-bb5c-0652646652c1 Jun 03 11:56:59 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:00 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76 1073741824" returned: 0 in 1.532s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:00 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76 Jun 03 11:57:00 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:00 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.63ec5b7a-1423-487b-bb5c-0652646652c1" returned: 0 in 1.243s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:57:00 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef362f6-5b80-463c-89ce-710a376ea64a]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:00 devstack sudo[95270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb Jun 03 11:57:00 devstack sudo[95270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:00 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76" returned: 0 in 0.913s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] <== create_volume: return (2526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:57:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.536s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be2de9f-7a9d-4d3a-9bc4-38ad745ce758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd68a82a-2188-43a0-b0ac-b5169174bf76', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca50981-d2a2-406c-b8e5-5ac169ef0c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:01 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Volume volume-fd68a82a-2188-43a0-b0ac-b5169174bf76 (fd68a82a-2188-43a0-b0ac-b5169174bf76): created successfully Jun 03 11:57:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca50981-d2a2-406c-b8e5-5ac169ef0c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Flow 'volume_create_manager' (0fe9531d-bb2a-42ca-8e2a-41b7d03472eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:57:01 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-325b5422-c14f-4ae3-9cbb-91ea8f44baed tempest-GroupSnapshotsTest-1791220728 None] Created volume successfully. Jun 03 11:57:01 devstack sudo[95270]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb" returned: 0 in 1.095s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:57:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.63ec5b7a-1423-487b-bb5c-0652646652c1 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:01 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.63ec5b7a-1423-487b-bb5c-0652646652c1 Jun 03 11:57:01 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:02 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:57:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Flow 'volume_create_manager' (cc0d5401-a1dc-4ea2-a445-8e766c3c616e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:57:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f51bfd-2a7d-47ec-8fca-f2314b6c14b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f51bfd-2a7d-47ec-8fca-f2314b6c14b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2072843262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6d0768-de93-4ed1-b29d-07a1ba59e7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdc8b5d1ad643c687bd41de0016939e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:57:02Z,use_quota=True,user_id='34b72677ac8c46fb9f3bbb01c7c07378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb13cf18-095e-4ce7-894d-80855e065a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb13cf18-095e-4ce7-894d-80855e065a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6771cda5-866f-467e-bb94-3675d3a44d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:02 devstack cinder-volume[86724]: DEBUG cinder.image.glance [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Creating Keystone auth plugin from conf {{(pid=86724) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 03 11:57:02 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-abb50c88-d7e9-46c8-900c-69a4d9e2a1fb tempest-GroupSnapshotsTest-1791220728 None] Update group completed successfully. Jun 03 11:57:02 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.63ec5b7a-1423-487b-bb5c-0652646652c1" returned: 0 in 0.858s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.63ec5b7a-1423-487b-bb5c-0652646652c1 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:02 devstack sudo[95286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.63ec5b7a-1423-487b-bb5c-0652646652c1 Jun 03 11:57:02 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6771cda5-866f-467e-bb94-3675d3a44d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8b6d0768-de93-4ed1-b29d-07a1ba59e7ad', 'volume_name': 'volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad', 'volume_size': 1, 'image_id': '0249897e-120c-42bb-b1a8-f517317c1907', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e70522cb7d6245e7970314b42bb711e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0249897e-120c-42bb-b1a8-f517317c1907', 'created_at': datetime.datetime(2026, 6, 3, 9, 43, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 9, 43, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0249897e-120c-42bb-b1a8-f517317c1907/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deadb4cd-3401-4a89-a903-e1f34410bfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deadb4cd-3401-4a89-a903-e1f34410bfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e43eb4-0b01-43bd-bb4b-1c4ef884c9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:02 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Volume 8b6d0768-de93-4ed1-b29d-07a1ba59e7ad: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad', 'volume_size': 1, 'image_id': '0249897e-120c-42bb-b1a8-f517317c1907', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e70522cb7d6245e7970314b42bb711e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0249897e-120c-42bb-b1a8-f517317c1907', 'created_at': datetime.datetime(2026, 6, 3, 9, 43, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 9, 43, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0249897e-120c-42bb-b1a8-f517317c1907/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 03 11:57:02 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Trying to clone 8b6d0768-de93-4ed1-b29d-07a1ba59e7ad from image 0249897e-120c-42bb-b1a8-f517317c1907 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}]). {{(pid=86724) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 03 11:57:03 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.63ec5b7a-1423-487b-bb5c-0652646652c1" returned: 0 in 0.665s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-quobyte-63ec5b7a-1423-487b-bb5c-0652646652c1" released by "_delete_snapshot" :: held 4.039s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:03 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_vyox8epldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 03 11:57:03 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Image download 20.69 MB at 20.69 MB/s Jun 03 11:57:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-quobyte-6e822c36-a896-4fc3-83b3-95dc2dd8915b" released by "delete_snapshot" :: held 4.082s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:03 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1c90b6-83e0-4e84-a126-75972bd4840c]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_vyox8epldevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:03 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] Created reservations ['2f3bfc88-8165-4cd6-b07d-2506171bad03', 'b217a6cf-5112-4fef-b22a-c8117c18061d', '5eeb67de-d808-4aa5-bdff-c6e4cc0a2fda', '8d5f6888-7aa9-4086-8f58-776dc9e15a5e'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:57:03 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] Delete snapshot completed successfully. Jun 03 11:57:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4bc5053b-62ea-49b6-87a1-0a77dffb8be0 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-63ec5b7a-1423-487b-bb5c-0652646652c1-delete_snapshot" released by "delete_snapshot" :: held 4.281s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:03 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_vyox8epldevstack@QuobyteHD Jun 03 11:57:03 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:03 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-bd3ec5e3-2352-45b7-b314-ec38b751f9af tempest-GroupSnapshotsTest-1791220728 None] Update group completed successfully. Jun 03 11:57:04 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_vyox8epldevstack@QuobyteHD" returned: 0 in 0.719s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:04 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Temporary image 0249897e-120c-42bb-b1a8-f517317c1907 is fetched for user 34b72677ac8c46fb9f3bbb01c7c07378. {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 03 11:57:04 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba01bb2-cd33-4bef-bd98-dc4e7fe27e71]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_vyox8epldevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:04 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_vyox8epldevstack@QuobyteHD Jun 03 11:57:04 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:04 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d9f0c615-659d-4017-b464-02fe9ed11745 tempest-GroupSnapshotsTest-1791220728 None] Update group completed successfully. Jun 03 11:57:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f026ae7d-5262-44a9-bfc0-f562da91e472 tempest-SnapshotsActionsTest-893138396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f026ae7d-5262-44a9-bfc0-f562da91e472 tempest-SnapshotsActionsTest-893138396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-f026ae7d-5262-44a9-bfc0-f562da91e472 tempest-SnapshotsActionsTest-893138396 None] Creating offline snapshot 1fe4610c-3092-4925-a368-fcb64b2f9a8a of volume 6e822c36-a896-4fc3-83b3-95dc2dd8915b {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 11:57:05 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_vyox8epldevstack@QuobyteHD" returned: 0 in 0.866s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:05 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e6847f-4630-41ec-9fda-78b1623e0725]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f026ae7d-5262-44a9-bfc0-f562da91e472 tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:05 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb Jun 03 11:57:05 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:05 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:57:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Flow 'volume_create_manager' (f7c77b3c-1375-4469-a076-3d12657a785a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:57:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c2e1aa-0533-4e0c-9577-ea26c7ae5aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c2e1aa-0533-4e0c-9577-ea26c7ae5aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1553751644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7cc0ef-0f5b-402d-88c3-6bb5034da180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c792d3c81ff40d28660becbb602cac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:57:05Z,use_quota=True,user_id='20db9e1dc9d94e37b27319e3de9dd3e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35fbe6a9-ce0d-47e4-908a-e7c0eb29d28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35fbe6a9-ce0d-47e4-908a-e7c0eb29d28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08afdd9d-ce01-4449-aa03-b402ee050cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08afdd9d-ce01-4449-aa03-b402ee050cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d7cc0ef-0f5b-402d-88c3-6bb5034da180', 'volume_name': 'volume-6d7cc0ef-0f5b-402d-88c3-6bb5034da180', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f151fc6-0559-4fdc-bea8-83991591d35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f151fc6-0559-4fdc-bea8-83991591d35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb794cdb-f526-402b-ba23-a9c1ef3fb5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:05 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Volume 6d7cc0ef-0f5b-402d-88c3-6bb5034da180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d7cc0ef-0f5b-402d-88c3-6bb5034da180', 'volume_size': 1} Jun 03 11:57:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:05 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f026ae7d-5262-44a9-bfc0-f562da91e472 tempest-SnapshotsActionsTest-893138396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb" returned: 0 in 0.758s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-f026ae7d-5262-44a9-bfc0-f562da91e472 tempest-SnapshotsActionsTest-893138396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:57:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f026ae7d-5262-44a9-bfc0-f562da91e472 tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.1fe4610c-3092-4925-a368-fcb64b2f9a8a 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:05 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.1fe4610c-3092-4925-a368-fcb64b2f9a8a 1G Jun 03 11:57:05 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:06 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-722cf730-f6e4-4c44-a41e-9bce13f5e7c8 tempest-GroupSnapshotsTest-1791220728 None] Update group completed successfully. Jun 03 11:57:06 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f026ae7d-5262-44a9-bfc0-f562da91e472 tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.1fe4610c-3092-4925-a368-fcb64b2f9a8a 1G" returned: 0 in 0.797s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f026ae7d-5262-44a9-bfc0-f562da91e472 tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.1fe4610c-3092-4925-a368-fcb64b2f9a8a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:06 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.1fe4610c-3092-4925-a368-fcb64b2f9a8a Jun 03 11:57:06 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:07 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f026ae7d-5262-44a9-bfc0-f562da91e472 tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.1fe4610c-3092-4925-a368-fcb64b2f9a8a" returned: 0 in 0.659s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:07 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-f026ae7d-5262-44a9-bfc0-f562da91e472 tempest-SnapshotsActionsTest-893138396 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.1fe4610c-3092-4925-a368-fcb64b2f9a8a is being set with open permissions: ugo+rw Jun 03 11:57:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f026ae7d-5262-44a9-bfc0-f562da91e472 tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.1fe4610c-3092-4925-a368-fcb64b2f9a8a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:07 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.1fe4610c-3092-4925-a368-fcb64b2f9a8a Jun 03 11:57:07 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:07 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] GroupSnapshot 5b661eb6-c873-4bde-b705-3268a6210561: creating. Jun 03 11:57:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] Group snapshot 5b661eb6-c873-4bde-b705-3268a6210561: creating. {{(pid=86724) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 03 11:57:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:07 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f026ae7d-5262-44a9-bfc0-f562da91e472 tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.1fe4610c-3092-4925-a368-fcb64b2f9a8a" returned: 0 in 0.616s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f026ae7d-5262-44a9-bfc0-f562da91e472 tempest-SnapshotsActionsTest-893138396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.933s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.875s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2072843262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6d0768-de93-4ed1-b29d-07a1ba59e7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdc8b5d1ad643c687bd41de0016939e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:57:02Z,use_quota=True,user_id='34b72677ac8c46fb9f3bbb01c7c07378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:57:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Creating volume 8b6d0768-de93-4ed1-b29d-07a1ba59e7ad {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:57:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:57:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:57:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:57:07 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:57:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:07 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad 1073741824 Jun 03 11:57:07 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:07 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-f026ae7d-5262-44a9-bfc0-f562da91e472 tempest-SnapshotsActionsTest-893138396 None] Create snapshot completed successfully Jun 03 11:57:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] Acquiring lock "cinder-1fe4610c-3092-4925-a368-fcb64b2f9a8a-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-1fe4610c-3092-4925-a368-fcb64b2f9a8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] Acquiring lock "cinder-quobyte-6e822c36-a896-4fc3-83b3-95dc2dd8915b" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-quobyte-6e822c36-a896-4fc3-83b3-95dc2dd8915b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] Acquiring lock "cinder-quobyte-1fe4610c-3092-4925-a368-fcb64b2f9a8a" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-quobyte-1fe4610c-3092-4925-a368-fcb64b2f9a8a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] Deleting offline snapshot 1fe4610c-3092-4925-a368-fcb64b2f9a8a of volume 6e822c36-a896-4fc3-83b3-95dc2dd8915b {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 11:57:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] snapshot_file for this snap is: volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.1fe4610c-3092-4925-a368-fcb64b2f9a8a {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 11:57:08 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ac2b07-954b-4d1a-9d4e-55c07fb07ef4]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.1fe4610c-3092-4925-a368-fcb64b2f9a8a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:08 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.1fe4610c-3092-4925-a368-fcb64b2f9a8a Jun 03 11:57:08 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:08 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad 1073741824" returned: 0 in 0.893s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:08 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad Jun 03 11:57:08 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:09 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.1fe4610c-3092-4925-a368-fcb64b2f9a8a" returned: 0 in 0.757s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb5a42d-5d81-449c-92ae-2d90b9314dd6]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:09 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb Jun 03 11:57:09 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:09 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad" returned: 0 in 0.620s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.961s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1553751644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7cc0ef-0f5b-402d-88c3-6bb5034da180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c792d3c81ff40d28660becbb602cac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:57:05Z,use_quota=True,user_id='20db9e1dc9d94e37b27319e3de9dd3e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Creating volume 6d7cc0ef-0f5b-402d-88c3-6bb5034da180 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:57:09 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6d7cc0ef-0f5b-402d-88c3-6bb5034da180 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:09 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6d7cc0ef-0f5b-402d-88c3-6bb5034da180 1073741824 Jun 03 11:57:09 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Attempting download of 0249897e-120c-42bb-b1a8-f517317c1907 ((None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}])) to volume 8b6d0768-de93-4ed1-b29d-07a1ba59e7ad. {{(pid=86724) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4b89a9-a56f-4783-9f59-bff3a7555f28]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_e8ya88k3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:09 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_e8ya88k3 Jun 03 11:57:09 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:09 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb" returned: 0 in 0.805s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:57:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.1fe4610c-3092-4925-a368-fcb64b2f9a8a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:09 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.1fe4610c-3092-4925-a368-fcb64b2f9a8a Jun 03 11:57:09 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:10 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6d7cc0ef-0f5b-402d-88c3-6bb5034da180 1073741824" returned: 0 in 0.780s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6d7cc0ef-0f5b-402d-88c3-6bb5034da180 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:10 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6d7cc0ef-0f5b-402d-88c3-6bb5034da180 Jun 03 11:57:10 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:10 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_e8ya88k3" returned: 0 in 0.803s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_e8ya88k3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:10 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_e8ya88k3 Jun 03 11:57:10 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:10 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.1fe4610c-3092-4925-a368-fcb64b2f9a8a" returned: 0 in 0.781s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.1fe4610c-3092-4925-a368-fcb64b2f9a8a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:10 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.1fe4610c-3092-4925-a368-fcb64b2f9a8a Jun 03 11:57:10 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:10 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6d7cc0ef-0f5b-402d-88c3-6bb5034da180" returned: 0 in 0.640s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:57:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.440s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] Creating offline snapshot ad9b961b-8f64-4e04-8816-f98e29276012 of volume e43b92ce-de79-420a-bdff-cfbbd9378f7c {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 11:57:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb794cdb-f526-402b-ba23-a9c1ef3fb5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d7cc0ef-0f5b-402d-88c3-6bb5034da180', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade3cec1-06b8-4130-9b96-197c9df48c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:11 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fadac2a-890a-432c-b728-b4017eb03fef]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:11 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Volume volume-6d7cc0ef-0f5b-402d-88c3-6bb5034da180 (6d7cc0ef-0f5b-402d-88c3-6bb5034da180): created successfully Jun 03 11:57:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade3cec1-06b8-4130-9b96-197c9df48c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Flow 'volume_create_manager' (f7c77b3c-1375-4469-a076-3d12657a785a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:57:11 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-2d2eaa9a-d95b-433f-ad89-b90e0f098018 tempest-ServersNegativeTestJSON-2080595210 None] Created volume successfully. Jun 03 11:57:11 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c Jun 03 11:57:11 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:11 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_e8ya88k3" returned: 1 in 0.769s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_e8ya88k3' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 11:57:11 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d353c7bf-8831-4cf2-a7e0-5599daa07fb3]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_vyox8epldevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:11 devstack sudo[95383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_vyox8epldevstack@QuobyteHD Jun 03 11:57:11 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:11 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.1fe4610c-3092-4925-a368-fcb64b2f9a8a" returned: 0 in 0.662s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:11 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-quobyte-1fe4610c-3092-4925-a368-fcb64b2f9a8a" released by "_delete_snapshot" :: held 3.110s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:11 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-quobyte-6e822c36-a896-4fc3-83b3-95dc2dd8915b" released by "delete_snapshot" :: held 3.134s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:11 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] Created reservations ['86a01801-e658-4627-9a88-2dbf1d0309d7', 'b8b01445-0f21-49be-b1b9-2710bfe536e1', 'd4d0aea7-c090-4b3f-add8-7a2527f11888', 'ae6597d8-fbca-42f2-a0c5-b5317cc413f9'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:57:11 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] Delete snapshot completed successfully. Jun 03 11:57:11 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ce98192e-e41c-47c8-bcf0-46367526e483 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-1fe4610c-3092-4925-a368-fcb64b2f9a8a-delete_snapshot" released by "delete_snapshot" :: held 3.275s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:11 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c" returned: 0 in 0.800s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.ad9b961b-8f64-4e04-8816-f98e29276012 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:11 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.ad9b961b-8f64-4e04-8816-f98e29276012 1G Jun 03 11:57:11 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:11 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_vyox8epldevstack@QuobyteHD" returned: 0 in 0.706s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:11 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] 0249897e-120c-42bb-b1a8-f517317c1907 was qcow2, converting to raw {{(pid=86724) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 03 11:57:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_vyox8epldevstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:11 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_vyox8epldevstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad Jun 03 11:57:11 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:12 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.ad9b961b-8f64-4e04-8816-f98e29276012 1G" returned: 0 in 0.910s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.ad9b961b-8f64-4e04-8816-f98e29276012 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:12 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.ad9b961b-8f64-4e04-8816-f98e29276012 Jun 03 11:57:12 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f7d831d4-eec1-4e25-a40c-72fcc38a5454 tempest-SnapshotsActionsTest-893138396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:13 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.ad9b961b-8f64-4e04-8816-f98e29276012" returned: 0 in 0.784s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:13 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.ad9b961b-8f64-4e04-8816-f98e29276012 is being set with open permissions: ugo+rw: NotImplementedError Jun 03 11:57:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.ad9b961b-8f64-4e04-8816-f98e29276012 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:13 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.ad9b961b-8f64-4e04-8816-f98e29276012 Jun 03 11:57:13 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:13 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:57:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Flow 'volume_create_manager' (5ac50c95-db39-497d-8ec4-3f252a5f9a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:57:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c48631-50e7-4ac9-8f76-f30ea4bbc672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c48631-50e7-4ac9-8f76-f30ea4bbc672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1202936415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c792d3c81ff40d28660becbb602cac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:57:14Z,use_quota=True,user_id='20db9e1dc9d94e37b27319e3de9dd3e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e2fa65-e866-42dd-b634-7a192a92b811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e2fa65-e866-42dd-b634-7a192a92b811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dddf58ec-ac85-47ec-9636-8c5b1ff2d2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dddf58ec-ac85-47ec-9636-8c5b1ff2d2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6', 'volume_name': 'volume-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d45208-4a8c-442a-bc14-bc3d8f3b4148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d45208-4a8c-442a-bc14-bc3d8f3b4148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff281b6f-aa1d-424f-913a-f046d96fd444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:13 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Volume b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6', 'volume_size': 1} Jun 03 11:57:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:14 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_vyox8epldevstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad" returned: 0 in 2.205s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:14 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_vyox8epldevstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 11:57:14 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Converted 112.00 MB image at 50.78 MB/s Jun 03 11:57:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:14 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad 1G Jun 03 11:57:14 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:14 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.ad9b961b-8f64-4e04-8816-f98e29276012" returned: 0 in 0.665s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:14 devstack sudo[95419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.info Jun 03 11:57:14 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:14 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad 1G" returned: 0 in 0.648s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:14 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedd7098-5c72-41f8-ac4f-9844893794f0]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:14 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.info" returned: 0 in 0.643s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:14 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.info is being set with open permissions: ugo+rw: NotImplementedError Jun 03 11:57:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:14 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad Jun 03 11:57:14 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:14 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.info Jun 03 11:57:14 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:15 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.info" returned: 0 in 0.609s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.514s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:15 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:15 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=110,cinder:UPDATE=114,cinder:INSERT=23,cinder:DELETE=3 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:57:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad" returned: 0 in 0.728s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] Creating offline snapshot b123a2d0-ae27-4bf8-9de8-e217fddee80a of volume fd68a82a-2188-43a0-b0ac-b5169174bf76 {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 11:57:15 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3308d201-bec2-4e42-8ae4-535a05369398]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:15 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad Jun 03 11:57:15 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:15 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76 Jun 03 11:57:15 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:16 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad" returned: 1 in 0.747s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 11:57:16 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Downloaded image 0249897e-120c-42bb-b1a8-f517317c1907 ((None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}])) to volume 8b6d0768-de93-4ed1-b29d-07a1ba59e7ad successfully. {{(pid=86724) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 03 11:57:16 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:16 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Temporary image 0249897e-120c-42bb-b1a8-f517317c1907 for user 34b72677ac8c46fb9f3bbb01c7c07378 is deleted. {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 03 11:57:16 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Marking volume 8b6d0768-de93-4ed1-b29d-07a1ba59e7ad as bootable. {{(pid=86724) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 03 11:57:16 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=104,cinder:UPDATE=106,cinder:INSERT=30,cinder:DELETE=11 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:57:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76" returned: 0 in 0.730s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.b123a2d0-ae27-4bf8-9de8-e217fddee80a 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:16 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Copying metadata from image 0249897e-120c-42bb-b1a8-f517317c1907 to 8b6d0768-de93-4ed1-b29d-07a1ba59e7ad. {{(pid=86724) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 03 11:57:16 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Creating volume glance metadata for volume 8b6d0768-de93-4ed1-b29d-07a1ba59e7ad backed by image 0249897e-120c-42bb-b1a8-f517317c1907 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0249897e-120c-42bb-b1a8-f517317c1907', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86724) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 03 11:57:16 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.b123a2d0-ae27-4bf8-9de8-e217fddee80a 1G Jun 03 11:57:16 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e43eb4-0b01-43bd-bb4b-1c4ef884c9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad', 'volume_size': 1, 'image_id': '0249897e-120c-42bb-b1a8-f517317c1907', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e70522cb7d6245e7970314b42bb711e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0249897e-120c-42bb-b1a8-f517317c1907', 'created_at': datetime.datetime(2026, 6, 3, 9, 43, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 9, 43, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0249897e-120c-42bb-b1a8-f517317c1907/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104e3669-287a-4700-ab36-734ca4a25055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:16 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Volume volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad (8b6d0768-de93-4ed1-b29d-07a1ba59e7ad): created successfully Jun 03 11:57:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104e3669-287a-4700-ab36-734ca4a25055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Flow 'volume_create_manager' (cc0d5401-a1dc-4ea2-a445-8e766c3c616e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:57:16 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-1c486e75-6805-446d-b16d-a4beb8af4825 tempest-VolumesExtendTest-1403756257 None] Created volume successfully. Jun 03 11:57:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-858ceebb-2c1b-4d72-a17a-e029d4a7cc87 tempest-VolumesExtendTest-1403756257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:17 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.b123a2d0-ae27-4bf8-9de8-e217fddee80a 1G" returned: 0 in 0.752s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd68a82a-2188-43a0-b0ac-b5169174bf76 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.b123a2d0-ae27-4bf8-9de8-e217fddee80a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:17 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd68a82a-2188-43a0-b0ac-b5169174bf76 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.b123a2d0-ae27-4bf8-9de8-e217fddee80a Jun 03 11:57:17 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:17 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd68a82a-2188-43a0-b0ac-b5169174bf76 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.b123a2d0-ae27-4bf8-9de8-e217fddee80a" returned: 0 in 0.650s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:17 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.b123a2d0-ae27-4bf8-9de8-e217fddee80a is being set with open permissions: ugo+rw: NotImplementedError Jun 03 11:57:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.b123a2d0-ae27-4bf8-9de8-e217fddee80a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:17 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.b123a2d0-ae27-4bf8-9de8-e217fddee80a Jun 03 11:57:17 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:18 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.b123a2d0-ae27-4bf8-9de8-e217fddee80a" returned: 0 in 0.615s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:18 devstack sudo[95456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.info Jun 03 11:57:18 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:18 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.info" returned: 0 in 0.604s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:18 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.info is being set with open permissions: ugo+rw: NotImplementedError Jun 03 11:57:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:18 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.info Jun 03 11:57:18 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:19 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.info" returned: 0 in 0.623s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.070s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.829s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1202936415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c792d3c81ff40d28660becbb602cac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:57:14Z,use_quota=True,user_id='20db9e1dc9d94e37b27319e3de9dd3e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:57:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Creating volume b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:57:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:57:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:57:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:57:19 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:57:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:19 devstack sudo[95462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6 1073741824 Jun 03 11:57:19 devstack sudo[95462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:19 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-daa4e6e2-7590-463d-a121-5f04a109deba tempest-GroupSnapshotsTest-1791220728 None] group_snapshot 5b661eb6-c873-4bde-b705-3268a6210561: created successfully Jun 03 11:57:20 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] group_snapshot 5b661eb6-c873-4bde-b705-3268a6210561: deleting Jun 03 11:57:20 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] group_snapshot 5b661eb6-c873-4bde-b705-3268a6210561: deleting {{(pid=86724) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 03 11:57:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "cinder-quobyte-e43b92ce-de79-420a-bdff-cfbbd9378f7c" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-e43b92ce-de79-420a-bdff-cfbbd9378f7c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "cinder-quobyte-ad9b961b-8f64-4e04-8816-f98e29276012" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-ad9b961b-8f64-4e04-8816-f98e29276012" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Deleting offline snapshot ad9b961b-8f64-4e04-8816-f98e29276012 of volume e43b92ce-de79-420a-bdff-cfbbd9378f7c {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 11:57:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] snapshot_file for this snap is: volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.ad9b961b-8f64-4e04-8816-f98e29276012 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 11:57:20 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d5178e-948f-4852-8661-9948e0eed9ca]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.ad9b961b-8f64-4e04-8816-f98e29276012 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:20 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.ad9b961b-8f64-4e04-8816-f98e29276012 Jun 03 11:57:20 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:20 devstack sudo[95462]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6 1073741824" returned: 0 in 0.980s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:20 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6 Jun 03 11:57:20 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:21 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:21 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.ad9b961b-8f64-4e04-8816-f98e29276012" returned: 0 in 0.793s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6" returned: 0 in 0.614s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:57:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:57:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f7d831d4-eec1-4e25-a40c-72fcc38a5454 tempest-SnapshotsActionsTest-893138396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.325s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:21 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[192bfe6d-b2ef-4c3b-9312-026581bbbe19]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff281b6f-aa1d-424f-913a-f046d96fd444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee21ae79-1fa0-4db7-8d8d-d3ab71c76b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-f7d831d4-eec1-4e25-a40c-72fcc38a5454 tempest-SnapshotsActionsTest-893138396 None] Creating offline snapshot 55880519-3ad5-4d34-8f3a-761287f4d3a3 of volume 6e822c36-a896-4fc3-83b3-95dc2dd8915b {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 11:57:21 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Volume volume-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6 (b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6): created successfully Jun 03 11:57:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee21ae79-1fa0-4db7-8d8d-d3ab71c76b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Flow 'volume_create_manager' (5ac50c95-db39-497d-8ec4-3f252a5f9a61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:57:21 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[722ac74f-e914-4c68-8391-af94ffe8bf31]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f7d831d4-eec1-4e25-a40c-72fcc38a5454 tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:21 devstack sudo[95487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c Jun 03 11:57:21 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:21 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-1cf3c3b6-70e2-48a1-93ee-dd252aaa7e28 tempest-ServersNegativeTestJSON-2080595210 None] Created volume successfully. Jun 03 11:57:21 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb Jun 03 11:57:21 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:22 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c" returned: 0 in 0.802s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.ad9b961b-8f64-4e04-8816-f98e29276012 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:22 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.ad9b961b-8f64-4e04-8816-f98e29276012 Jun 03 11:57:22 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:22 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f7d831d4-eec1-4e25-a40c-72fcc38a5454 tempest-SnapshotsActionsTest-893138396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb" returned: 0 in 0.777s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-f7d831d4-eec1-4e25-a40c-72fcc38a5454 tempest-SnapshotsActionsTest-893138396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:57:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f7d831d4-eec1-4e25-a40c-72fcc38a5454 tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.55880519-3ad5-4d34-8f3a-761287f4d3a3 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:22 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.55880519-3ad5-4d34-8f3a-761287f4d3a3 1G Jun 03 11:57:22 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-aa125d25-321e-4950-adb7-cab97a6fda78 tempest-ServersNegativeTestJSON-2080595210 None] Acquiring lock "cinder-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-aa125d25-321e-4950-adb7-cab97a6fda78 tempest-ServersNegativeTestJSON-2080595210 None] Lock "cinder-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-aa125d25-321e-4950-adb7-cab97a6fda78 tempest-ServersNegativeTestJSON-2080595210 None] Acquiring lock "cinder-quobyte-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-aa125d25-321e-4950-adb7-cab97a6fda78 tempest-ServersNegativeTestJSON-2080595210 None] Lock "cinder-quobyte-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6" acquired by "delete_volume" :: waited 0.018s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:22 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd5a4ed-f9f5-45e5-8d6d-261a53ba4fc6]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa125d25-321e-4950-adb7-cab97a6fda78 tempest-ServersNegativeTestJSON-2080595210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:22 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.ad9b961b-8f64-4e04-8816-f98e29276012" returned: 0 in 0.852s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.ad9b961b-8f64-4e04-8816-f98e29276012 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:22 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.ad9b961b-8f64-4e04-8816-f98e29276012 Jun 03 11:57:22 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:22 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6 Jun 03 11:57:22 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:23 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f7d831d4-eec1-4e25-a40c-72fcc38a5454 tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.55880519-3ad5-4d34-8f3a-761287f4d3a3 1G" returned: 0 in 1.015s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f7d831d4-eec1-4e25-a40c-72fcc38a5454 tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.55880519-3ad5-4d34-8f3a-761287f4d3a3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:23 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.55880519-3ad5-4d34-8f3a-761287f4d3a3 Jun 03 11:57:23 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:23 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c.ad9b961b-8f64-4e04-8816-f98e29276012" returned: 0 in 0.626s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-ad9b961b-8f64-4e04-8816-f98e29276012" released by "_delete_snapshot" :: held 3.198s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-e43b92ce-de79-420a-bdff-cfbbd9378f7c" released by "delete_snapshot" :: held 3.224s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "cinder-quobyte-fd68a82a-2188-43a0-b0ac-b5169174bf76" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-fd68a82a-2188-43a0-b0ac-b5169174bf76" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "cinder-quobyte-b123a2d0-ae27-4bf8-9de8-e217fddee80a" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-b123a2d0-ae27-4bf8-9de8-e217fddee80a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:23 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Deleting offline snapshot b123a2d0-ae27-4bf8-9de8-e217fddee80a of volume fd68a82a-2188-43a0-b0ac-b5169174bf76 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 11:57:23 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:23 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] snapshot_file for this snap is: volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.b123a2d0-ae27-4bf8-9de8-e217fddee80a {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 11:57:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa125d25-321e-4950-adb7-cab97a6fda78 tempest-ServersNegativeTestJSON-2080595210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6" returned: 0 in 0.881s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa125d25-321e-4950-adb7-cab97a6fda78 tempest-ServersNegativeTestJSON-2080595210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:23 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebc77a2-8e85-48e3-ba3a-c20659d9b939]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.b123a2d0-ae27-4bf8-9de8-e217fddee80a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:23 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6 Jun 03 11:57:23 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:23 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.b123a2d0-ae27-4bf8-9de8-e217fddee80a Jun 03 11:57:23 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:23 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f7d831d4-eec1-4e25-a40c-72fcc38a5454 tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.55880519-3ad5-4d34-8f3a-761287f4d3a3" returned: 0 in 0.734s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:23 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-f7d831d4-eec1-4e25-a40c-72fcc38a5454 tempest-SnapshotsActionsTest-893138396 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.55880519-3ad5-4d34-8f3a-761287f4d3a3 is being set with open permissions: ugo+rw Jun 03 11:57:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f7d831d4-eec1-4e25-a40c-72fcc38a5454 tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.55880519-3ad5-4d34-8f3a-761287f4d3a3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:23 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.55880519-3ad5-4d34-8f3a-761287f4d3a3 Jun 03 11:57:23 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:24 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa125d25-321e-4950-adb7-cab97a6fda78 tempest-ServersNegativeTestJSON-2080595210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6" returned: 0 in 0.635s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-aa125d25-321e-4950-adb7-cab97a6fda78 tempest-ServersNegativeTestJSON-2080595210 None] Lock "cinder-quobyte-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6" released by "delete_volume" :: held 1.569s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:24 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-aa125d25-321e-4950-adb7-cab97a6fda78 tempest-ServersNegativeTestJSON-2080595210 None] Created reservations ['fc1628ab-2f7b-431f-b478-55f4aa81292d', '81072cc1-f143-442c-b5b1-157d242b2ec9', 'cf7a3f28-fef2-4924-91da-34c25278ce97', '9599d6fa-5afa-45cc-9b00-7b523ca3a3c6'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:57:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-aa125d25-321e-4950-adb7-cab97a6fda78 tempest-ServersNegativeTestJSON-2080595210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-aa125d25-321e-4950-adb7-cab97a6fda78 tempest-ServersNegativeTestJSON-2080595210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-aa125d25-321e-4950-adb7-cab97a6fda78 tempest-ServersNegativeTestJSON-2080595210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:57:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-aa125d25-321e-4950-adb7-cab97a6fda78 tempest-ServersNegativeTestJSON-2080595210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:57:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-aa125d25-321e-4950-adb7-cab97a6fda78 tempest-ServersNegativeTestJSON-2080595210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa125d25-321e-4950-adb7-cab97a6fda78 tempest-ServersNegativeTestJSON-2080595210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:24 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:57:24 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:24 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:24 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.b123a2d0-ae27-4bf8-9de8-e217fddee80a" returned: 0 in 0.817s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f7d831d4-eec1-4e25-a40c-72fcc38a5454 tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.55880519-3ad5-4d34-8f3a-761287f4d3a3" returned: 0 in 0.639s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd68a82a-2188-43a0-b0ac-b5169174bf76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:57:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f7d831d4-eec1-4e25-a40c-72fcc38a5454 tempest-SnapshotsActionsTest-893138396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.322s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:24 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8c720b-0426-4f26-a819-feaf9ec5c191]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-858ceebb-2c1b-4d72-a17a-e029d4a7cc87 tempest-VolumesExtendTest-1403756257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 7.950s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:24 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c28007-c2bb-41d6-98ee-09158d1021b1]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-858ceebb-2c1b-4d72-a17a-e029d4a7cc87 tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:24 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-f7d831d4-eec1-4e25-a40c-72fcc38a5454 tempest-SnapshotsActionsTest-893138396 None] Create snapshot completed successfully Jun 03 11:57:24 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76 Jun 03 11:57:24 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:24 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad Jun 03 11:57:24 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5d3aeae1-2363-4c78-bba2-8ab332d2c046 tempest-ServersNegativeTestJSON-2080595210 None] Acquiring lock "cinder-6d7cc0ef-0f5b-402d-88c3-6bb5034da180-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5d3aeae1-2363-4c78-bba2-8ab332d2c046 tempest-ServersNegativeTestJSON-2080595210 None] Lock "cinder-6d7cc0ef-0f5b-402d-88c3-6bb5034da180-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5d3aeae1-2363-4c78-bba2-8ab332d2c046 tempest-ServersNegativeTestJSON-2080595210 None] Acquiring lock "cinder-quobyte-6d7cc0ef-0f5b-402d-88c3-6bb5034da180" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5d3aeae1-2363-4c78-bba2-8ab332d2c046 tempest-ServersNegativeTestJSON-2080595210 None] Lock "cinder-quobyte-6d7cc0ef-0f5b-402d-88c3-6bb5034da180" acquired by "delete_volume" :: waited 0.019s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:25 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[62176214-eaf8-4446-9a9c-728eeb5a5715]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5d3aeae1-2363-4c78-bba2-8ab332d2c046 tempest-ServersNegativeTestJSON-2080595210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6d7cc0ef-0f5b-402d-88c3-6bb5034da180 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa125d25-321e-4950-adb7-cab97a6fda78 tempest-ServersNegativeTestJSON-2080595210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.685s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-aa125d25-321e-4950-adb7-cab97a6fda78 tempest-ServersNegativeTestJSON-2080595210 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:57:25 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-aa125d25-321e-4950-adb7-cab97a6fda78 tempest-ServersNegativeTestJSON-2080595210 None] Deleted volume successfully. Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-aa125d25-321e-4950-adb7-cab97a6fda78 tempest-ServersNegativeTestJSON-2080595210 None] Lock "cinder-b4b4a59f-4cda-455e-b7a1-f460fb9f2ca6-delete_volume" released by "delete_volume" :: held 2.501s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:25 devstack sudo[95541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6d7cc0ef-0f5b-402d-88c3-6bb5034da180 Jun 03 11:57:25 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:25 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-858ceebb-2c1b-4d72-a17a-e029d4a7cc87 tempest-VolumesExtendTest-1403756257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad" returned: 0 in 0.883s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-858ceebb-2c1b-4d72-a17a-e029d4a7cc87 tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] Acquiring lock "cinder-55880519-3ad5-4d34-8f3a-761287f4d3a3-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-55880519-3ad5-4d34-8f3a-761287f4d3a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] Acquiring lock "cinder-quobyte-6e822c36-a896-4fc3-83b3-95dc2dd8915b" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:25 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-quobyte-6e822c36-a896-4fc3-83b3-95dc2dd8915b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] Acquiring lock "cinder-quobyte-55880519-3ad5-4d34-8f3a-761287f4d3a3" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76" returned: 0 in 1.012s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.b123a2d0-ae27-4bf8-9de8-e217fddee80a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-quobyte-55880519-3ad5-4d34-8f3a-761287f4d3a3" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] Deleting offline snapshot 55880519-3ad5-4d34-8f3a-761287f4d3a3 of volume 6e822c36-a896-4fc3-83b3-95dc2dd8915b {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 11:57:25 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.b123a2d0-ae27-4bf8-9de8-e217fddee80a Jun 03 11:57:25 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] snapshot_file for this snap is: volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.55880519-3ad5-4d34-8f3a-761287f4d3a3 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 11:57:25 devstack sudo[95548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad Jun 03 11:57:25 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7e3aa9-6540-4a80-8fbc-b574b661969b]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.55880519-3ad5-4d34-8f3a-761287f4d3a3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:25 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.55880519-3ad5-4d34-8f3a-761287f4d3a3 Jun 03 11:57:25 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:26 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5d3aeae1-2363-4c78-bba2-8ab332d2c046 tempest-ServersNegativeTestJSON-2080595210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6d7cc0ef-0f5b-402d-88c3-6bb5034da180" returned: 0 in 0.898s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5d3aeae1-2363-4c78-bba2-8ab332d2c046 tempest-ServersNegativeTestJSON-2080595210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6d7cc0ef-0f5b-402d-88c3-6bb5034da180 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:26 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6d7cc0ef-0f5b-402d-88c3-6bb5034da180 Jun 03 11:57:26 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:26 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-858ceebb-2c1b-4d72-a17a-e029d4a7cc87 tempest-VolumesExtendTest-1403756257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad" returned: 1 in 0.847s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-858ceebb-2c1b-4d72-a17a-e029d4a7cc87 tempest-VolumesExtendTest-1403756257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-858ceebb-2c1b-4d72-a17a-e029d4a7cc87 tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad 2G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:26 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.b123a2d0-ae27-4bf8-9de8-e217fddee80a" returned: 0 in 0.826s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.b123a2d0-ae27-4bf8-9de8-e217fddee80a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-858ceebb-2c1b-4d72-a17a-e029d4a7cc87 tempest-VolumesExtendTest-1403756257 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad 2G" returned: 0 in 0.081s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-858ceebb-2c1b-4d72-a17a-e029d4a7cc87 tempest-VolumesExtendTest-1403756257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.859s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:26 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.b123a2d0-ae27-4bf8-9de8-e217fddee80a Jun 03 11:57:26 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:26 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-858ceebb-2c1b-4d72-a17a-e029d4a7cc87 tempest-VolumesExtendTest-1403756257 None] Extend volume completed successfully. Jun 03 11:57:26 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.55880519-3ad5-4d34-8f3a-761287f4d3a3" returned: 0 in 0.829s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[393abae8-bc04-4478-91d1-8682427a7566]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:26 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb Jun 03 11:57:26 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:26 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5d3aeae1-2363-4c78-bba2-8ab332d2c046 tempest-ServersNegativeTestJSON-2080595210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6d7cc0ef-0f5b-402d-88c3-6bb5034da180" returned: 0 in 0.708s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5d3aeae1-2363-4c78-bba2-8ab332d2c046 tempest-ServersNegativeTestJSON-2080595210 None] Lock "cinder-quobyte-6d7cc0ef-0f5b-402d-88c3-6bb5034da180" released by "delete_volume" :: held 1.672s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-5d3aeae1-2363-4c78-bba2-8ab332d2c046 tempest-ServersNegativeTestJSON-2080595210 None] Created reservations ['a0caaacb-d1ae-46b7-95e0-7bade982399f', '108e066e-071b-42d2-8e3f-3ae17e480c17', 'de4042d9-a6c8-4c18-996f-6a007c3f802f', 'bd9e3cd5-19ad-44f1-94db-620186114acd'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5d3aeae1-2363-4c78-bba2-8ab332d2c046 tempest-ServersNegativeTestJSON-2080595210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5d3aeae1-2363-4c78-bba2-8ab332d2c046 tempest-ServersNegativeTestJSON-2080595210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5d3aeae1-2363-4c78-bba2-8ab332d2c046 tempest-ServersNegativeTestJSON-2080595210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5d3aeae1-2363-4c78-bba2-8ab332d2c046 tempest-ServersNegativeTestJSON-2080595210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5d3aeae1-2363-4c78-bba2-8ab332d2c046 tempest-ServersNegativeTestJSON-2080595210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5d3aeae1-2363-4c78-bba2-8ab332d2c046 tempest-ServersNegativeTestJSON-2080595210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:26 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:57:26 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:27 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76.b123a2d0-ae27-4bf8-9de8-e217fddee80a" returned: 0 in 0.648s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-b123a2d0-ae27-4bf8-9de8-e217fddee80a" released by "_delete_snapshot" :: held 3.442s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-fd68a82a-2188-43a0-b0ac-b5169174bf76" released by "delete_snapshot" :: held 3.466s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:27 devstack cinder-volume[86724]: WARNING cinder.quota [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1968686608 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1968686608, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:57:27 devstack cinder-volume[86724]: WARNING cinder.quota [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1968686608 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1968686608, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:57:27 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Created reservations ['003b83e8-c93c-4c04-baf0-a7b037810ae2', '3151ce5f-228a-406c-b8b2-0d595deddf26', '29047824-8529-4e0e-ad6f-db941713ce7a', 'ed6246d7-a5f8-48d4-8468-72610e1f2047'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:57:27 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] Created reservations ['081e1a44-b857-4dd5-bf70-c3409db9e4f7', '7cd15226-026b-4cae-9b91-65270a2182ce', 'd429a808-71ba-4be0-959d-acdfe7bae198', '23f2a758-19a3-4d62-8581-450c32b58239'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:57:27 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb" returned: 0 in 0.920s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:57:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.55880519-3ad5-4d34-8f3a-761287f4d3a3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:27 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.55880519-3ad5-4d34-8f3a-761287f4d3a3 Jun 03 11:57:27 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:27 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-279b2eaa-47c8-4739-a0d9-e7c8d4b2b089 tempest-GroupSnapshotsTest-1791220728 None] group_snapshot 5b661eb6-c873-4bde-b705-3268a6210561: deleted successfully Jun 03 11:57:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] Acquiring lock "cinder-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] Lock "cinder-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] Acquiring lock "cinder-quobyte-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:27 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] Lock "cinder-quobyte-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad" acquired by "delete_volume" :: waited 0.021s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5d3aeae1-2363-4c78-bba2-8ab332d2c046 tempest-ServersNegativeTestJSON-2080595210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.848s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:27 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5d3aeae1-2363-4c78-bba2-8ab332d2c046 tempest-ServersNegativeTestJSON-2080595210 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:57:27 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-5d3aeae1-2363-4c78-bba2-8ab332d2c046 tempest-ServersNegativeTestJSON-2080595210 None] Deleted volume successfully. Jun 03 11:57:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5d3aeae1-2363-4c78-bba2-8ab332d2c046 tempest-ServersNegativeTestJSON-2080595210 None] Lock "cinder-6d7cc0ef-0f5b-402d-88c3-6bb5034da180-delete_volume" released by "delete_volume" :: held 2.742s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:27 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[485acdd7-fb53-4168-8291-cb4fc811b9c3]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:27 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad Jun 03 11:57:27 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:28 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "cinder-quobyte-e43b92ce-de79-420a-bdff-cfbbd9378f7c" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:28 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-e43b92ce-de79-420a-bdff-cfbbd9378f7c" acquired by "delete_volume" :: waited 0.025s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:28 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6206ba-d38f-4f25-9dab-ea5d1c664b19]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:28 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c Jun 03 11:57:28 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:28 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.55880519-3ad5-4d34-8f3a-761287f4d3a3" returned: 0 in 0.941s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.55880519-3ad5-4d34-8f3a-761287f4d3a3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:28 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.55880519-3ad5-4d34-8f3a-761287f4d3a3 Jun 03 11:57:28 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:28 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad" returned: 0 in 1.091s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:28 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad Jun 03 11:57:28 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:29 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.55880519-3ad5-4d34-8f3a-761287f4d3a3" returned: 0 in 0.940s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:29 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c" returned: 0 in 1.164s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:29 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-quobyte-55880519-3ad5-4d34-8f3a-761287f4d3a3" released by "_delete_snapshot" :: held 3.836s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:29 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-quobyte-6e822c36-a896-4fc3-83b3-95dc2dd8915b" released by "delete_snapshot" :: held 3.878s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:29 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c Jun 03 11:57:29 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:29 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] Created reservations ['f448f19d-aaf2-4ca3-9f97-d92119b24e20', '955268bf-8035-41f9-90c7-efe382f612f4', 'cd511d4d-febc-491b-a494-6e19b49a94ab', 'a0648b62-d7b3-459b-90b6-50f07a915cbb'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:57:29 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] Delete snapshot completed successfully. Jun 03 11:57:29 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d0619efd-fb15-486b-8247-f03d1bd123c8 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-55880519-3ad5-4d34-8f3a-761287f4d3a3-delete_snapshot" released by "delete_snapshot" :: held 4.076s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:29 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad" returned: 1 in 0.910s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 11:57:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:29 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad Jun 03 11:57:29 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:30 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e43b92ce-de79-420a-bdff-cfbbd9378f7c" returned: 0 in 0.767s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-e43b92ce-de79-420a-bdff-cfbbd9378f7c" released by "delete_volume" :: held 2.025s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "cinder-quobyte-fd68a82a-2188-43a0-b0ac-b5169174bf76" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-fd68a82a-2188-43a0-b0ac-b5169174bf76" acquired by "delete_volume" :: waited 0.021s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cd582e8e-f54b-4bb1-bb16-c71e0f6f5b7b tempest-SnapshotsActionsTest-893138396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cd582e8e-f54b-4bb1-bb16-c71e0f6f5b7b tempest-SnapshotsActionsTest-893138396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:30 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42c5c90-a4d3-47ca-9620-d747623f22db]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:30 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-cd582e8e-f54b-4bb1-bb16-c71e0f6f5b7b tempest-SnapshotsActionsTest-893138396 None] Creating offline snapshot 870a22c6-1139-4ab7-91ef-6ece981de6c4 of volume 6e822c36-a896-4fc3-83b3-95dc2dd8915b {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 11:57:30 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ff6000-58ff-49cd-9402-cea7d607f83d]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cd582e8e-f54b-4bb1-bb16-c71e0f6f5b7b tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:30 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76 Jun 03 11:57:30 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:30 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb Jun 03 11:57:30 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:30 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad" returned: 0 in 0.830s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] Lock "cinder-quobyte-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad" released by "delete_volume" :: held 2.950s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:30 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] Created reservations ['6d1b26ea-f40e-4fbf-8ffa-519d23151835', 'f14ad253-f43f-47b9-a038-6e49c676a92f', 'dd437615-f3c4-4996-bad0-e62f7d43f9a7', '75d980cd-db37-44b3-9f4e-f5201cbbf096'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:57:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:30 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:57:30 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:57:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:30 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:57:30 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:31 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76" returned: 0 in 1.003s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:31 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cd582e8e-f54b-4bb1-bb16-c71e0f6f5b7b tempest-SnapshotsActionsTest-893138396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb" returned: 0 in 0.940s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:31 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-cd582e8e-f54b-4bb1-bb16-c71e0f6f5b7b tempest-SnapshotsActionsTest-893138396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:57:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cd582e8e-f54b-4bb1-bb16-c71e0f6f5b7b tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.870a22c6-1139-4ab7-91ef-6ece981de6c4 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:31 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76 Jun 03 11:57:31 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:31 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.870a22c6-1139-4ab7-91ef-6ece981de6c4 1G Jun 03 11:57:31 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:31 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:57:31 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:31 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Flow 'volume_create_manager' (3064a827-c960-4276-a9ed-fad02a8106d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:57:31 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8326e585-449a-4007-8c4f-b55be04712f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.825s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:31 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:57:31 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8326e585-449a-4007-8c4f-b55be04712f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1094561069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32872244-76e0-4e96-aebe-1830c73562f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdc8b5d1ad643c687bd41de0016939e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:57:32Z,use_quota=True,user_id='34b72677ac8c46fb9f3bbb01c7c07378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:31 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2148c3-e083-476c-b1be-b83c51698820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:31 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2148c3-e083-476c-b1be-b83c51698820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:31 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8feeb945-c4ac-4928-82dd-0178da22f4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:31 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8feeb945-c4ac-4928-82dd-0178da22f4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32872244-76e0-4e96-aebe-1830c73562f5', 'volume_name': 'volume-32872244-76e0-4e96-aebe-1830c73562f5', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:31 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a23d017-ce81-49d1-a678-128ac3e3cd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:31 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a23d017-ce81-49d1-a678-128ac3e3cd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:31 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2aa1f0f-a23d-466b-8b0f-09066b12c7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:31 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Volume 32872244-76e0-4e96-aebe-1830c73562f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32872244-76e0-4e96-aebe-1830c73562f5', 'volume_size': 1} Jun 03 11:57:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:31 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] Deleted volume successfully. Jun 03 11:57:31 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-eeda799b-fe68-4c8f-a816-364008eede5c tempest-VolumesExtendTest-1403756257 None] Lock "cinder-8b6d0768-de93-4ed1-b29d-07a1ba59e7ad-delete_volume" released by "delete_volume" :: held 4.078s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:32 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fd68a82a-2188-43a0-b0ac-b5169174bf76" returned: 0 in 0.726s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-fd68a82a-2188-43a0-b0ac-b5169174bf76" released by "delete_volume" :: held 1.805s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:32 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Created reservations ['6ec2086e-cf25-488d-9e45-003074d2b12b'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:57:32 devstack cinder-volume[86724]: WARNING cinder.quota [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1968686608 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1968686608, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:57:32 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Created reservations ['4e3be1cf-ebc3-4846-9170-87adf3a252cc', '33d38c13-290f-4395-a067-53a13700df1f', '17e43b98-067f-4eb3-bd64-1baa18ce6e93', '43eae41e-c297-42d4-b587-f810332936ae'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:57:32 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cd582e8e-f54b-4bb1-bb16-c71e0f6f5b7b tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.870a22c6-1139-4ab7-91ef-6ece981de6c4 1G" returned: 0 in 0.904s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cd582e8e-f54b-4bb1-bb16-c71e0f6f5b7b tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.870a22c6-1139-4ab7-91ef-6ece981de6c4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:32 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.870a22c6-1139-4ab7-91ef-6ece981de6c4 Jun 03 11:57:32 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:32 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Created reservations ['e3d9253d-b05a-458d-8949-acb8ca27c06b', 'e85a3df8-c637-4bea-a5f2-328580bc4c12', '7d5e081c-c79f-4ba6-a938-b738467e18df', '00baebad-4ee5-448d-b0b1-e9cdb2b7b2fc'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:57:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:32 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:57:32 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:57:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:32 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:57:32 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:32 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cd582e8e-f54b-4bb1-bb16-c71e0f6f5b7b tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.870a22c6-1139-4ab7-91ef-6ece981de6c4" returned: 0 in 0.748s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:32 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-cd582e8e-f54b-4bb1-bb16-c71e0f6f5b7b tempest-SnapshotsActionsTest-893138396 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.870a22c6-1139-4ab7-91ef-6ece981de6c4 is being set with open permissions: ugo+rw Jun 03 11:57:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cd582e8e-f54b-4bb1-bb16-c71e0f6f5b7b tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.870a22c6-1139-4ab7-91ef-6ece981de6c4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:33 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.870a22c6-1139-4ab7-91ef-6ece981de6c4 Jun 03 11:57:33 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:33 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.649s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:33 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:57:33 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-da1e5ee2-bee7-4832-90bd-fcea2866ba3b tempest-GroupSnapshotsTest-1791220728 None] Delete group completed successfully. Jun 03 11:57:33 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-4ef87939-c8cb-43d0-b999-34ed3624ea09 tempest-GroupSnapshotsTest-1791220728 None] Group tempest-GroupSnapshotsTest-Group-1639626562: creating Jun 03 11:57:33 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-4ef87939-c8cb-43d0-b999-34ed3624ea09 tempest-GroupSnapshotsTest-1791220728 None] Group tempest-GroupSnapshotsTest-Group-1639626562: created successfully Jun 03 11:57:33 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-4ef87939-c8cb-43d0-b999-34ed3624ea09 tempest-GroupSnapshotsTest-1791220728 None] Create group completed successfully. Jun 03 11:57:33 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cd582e8e-f54b-4bb1-bb16-c71e0f6f5b7b tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.870a22c6-1139-4ab7-91ef-6ece981de6c4" returned: 0 in 0.686s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cd582e8e-f54b-4bb1-bb16-c71e0f6f5b7b tempest-SnapshotsActionsTest-893138396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.423s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.032s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:33 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1094561069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32872244-76e0-4e96-aebe-1830c73562f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdc8b5d1ad643c687bd41de0016939e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:57:32Z,use_quota=True,user_id='34b72677ac8c46fb9f3bbb01c7c07378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:57:33 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Creating volume 32872244-76e0-4e96-aebe-1830c73562f5 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:57:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:33 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:57:33 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:57:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:33 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:57:33 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:57:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:33 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5 1073741824 Jun 03 11:57:33 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:33 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-cd582e8e-f54b-4bb1-bb16-c71e0f6f5b7b tempest-SnapshotsActionsTest-893138396 None] Create snapshot completed successfully Jun 03 11:57:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] Acquiring lock "cinder-870a22c6-1139-4ab7-91ef-6ece981de6c4-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-870a22c6-1139-4ab7-91ef-6ece981de6c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] Acquiring lock "cinder-quobyte-6e822c36-a896-4fc3-83b3-95dc2dd8915b" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:34 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5 1073741824" returned: 0 in 0.915s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-quobyte-6e822c36-a896-4fc3-83b3-95dc2dd8915b" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] Acquiring lock "cinder-quobyte-870a22c6-1139-4ab7-91ef-6ece981de6c4" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-quobyte-870a22c6-1139-4ab7-91ef-6ece981de6c4" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:34 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] Deleting offline snapshot 870a22c6-1139-4ab7-91ef-6ece981de6c4 of volume 6e822c36-a896-4fc3-83b3-95dc2dd8915b {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 11:57:34 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] snapshot_file for this snap is: volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.870a22c6-1139-4ab7-91ef-6ece981de6c4 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 11:57:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:34 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7346f9-7fe2-4f5a-b48f-9054f7544ff8]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.870a22c6-1139-4ab7-91ef-6ece981de6c4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:34 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5 Jun 03 11:57:34 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:34 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.870a22c6-1139-4ab7-91ef-6ece981de6c4 Jun 03 11:57:34 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Flow 'volume_create_manager' (9a12cf6f-dbd5-4c03-ba0a-17dd91b0c126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63dbe244-4d6c-4baf-9823-c2755b5de029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63dbe244-4d6c-4baf-9823-c2755b5de029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1953251085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1e38739-337c-485e-8e5b-96e576323e20,host='devstack@QuobyteHD#QuobyteHD',id=85dc3fd8-03a7-4382-9fc6-de5e041c2fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c723860b5754be586565fb00f9436d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:57:35Z,use_quota=True,user_id='57defcafdfbc41ae93c472fc75992aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f0bcba7-9d8f-40db-b8cf-943b3c061db0),volume_type_id=5f0bcba7-9d8f-40db-b8cf-943b3c061db0)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924b813a-6a68-4083-82c9-3536457079bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924b813a-6a68-4083-82c9-3536457079bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5ea924-a06a-4cbf-a275-34dddfd52092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5ea924-a06a-4cbf-a275-34dddfd52092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85dc3fd8-03a7-4382-9fc6-de5e041c2fb2', 'volume_name': 'volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07a0872-84b4-493b-b1fb-6841f6a86905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07a0872-84b4-493b-b1fb-6841f6a86905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb02040-5551-4569-a625-efce5fa58690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:35 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Volume 85dc3fd8-03a7-4382-9fc6-de5e041c2fb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2', 'volume_size': 1} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:35 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5" returned: 0 in 0.784s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.278s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d1e38739-337c-485e-8e5b-96e576323e20,created_at=2026-06-03T09:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1953251085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1e38739-337c-485e-8e5b-96e576323e20,host='devstack@QuobyteHD#QuobyteHD',id=85dc3fd8-03a7-4382-9fc6-de5e041c2fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c723860b5754be586565fb00f9436d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:57:35Z,use_quota=True,user_id='57defcafdfbc41ae93c472fc75992aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f0bcba7-9d8f-40db-b8cf-943b3c061db0),volume_type_id=5f0bcba7-9d8f-40db-b8cf-943b3c061db0)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Creating volume 85dc3fd8-03a7-4382-9fc6-de5e041c2fb2 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:57:35 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2aa1f0f-a23d-466b-8b0f-09066b12c7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32872244-76e0-4e96-aebe-1830c73562f5', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:35 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2 1073741824 Jun 03 11:57:35 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d844b822-49bd-49c5-91e7-701f656fc9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:35 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Volume volume-32872244-76e0-4e96-aebe-1830c73562f5 (32872244-76e0-4e96-aebe-1830c73562f5): created successfully Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d844b822-49bd-49c5-91e7-701f656fc9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Flow 'volume_create_manager' (3064a827-c960-4276-a9ed-fad02a8106d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:57:35 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-7a84a332-5f22-43b9-b7cb-6bbc3e77e89a tempest-VolumesExtendTest-1403756257 None] Created volume successfully. Jun 03 11:57:35 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.870a22c6-1139-4ab7-91ef-6ece981de6c4" returned: 0 in 1.010s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cc98df-ea9e-425b-a41f-f5668eba288c]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:36 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb Jun 03 11:57:36 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a6f515da-109f-46e3-a1dd-db9f1da8fefe tempest-VolumesExtendTest-1403756257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:36 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2 1073741824" returned: 0 in 1.038s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:36 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2 Jun 03 11:57:36 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:36 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb" returned: 0 in 0.870s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:57:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.870a22c6-1139-4ab7-91ef-6ece981de6c4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:36 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.870a22c6-1139-4ab7-91ef-6ece981de6c4 Jun 03 11:57:36 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 11:57:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:57:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:57:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:36 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:57:36 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:37 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2" returned: 0 in 0.795s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:57:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a6f515da-109f-46e3-a1dd-db9f1da8fefe tempest-VolumesExtendTest-1403756257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.222s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb02040-5551-4569-a625-efce5fa58690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad16a562-5fe4-47f5-944d-9a0095b8b8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-a6f515da-109f-46e3-a1dd-db9f1da8fefe tempest-VolumesExtendTest-1403756257 None] Creating offline snapshot 731bfd56-5b00-4ba5-9ae9-e828717db604 of volume 32872244-76e0-4e96-aebe-1830c73562f5 {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 11:57:37 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Volume volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2 (85dc3fd8-03a7-4382-9fc6-de5e041c2fb2): created successfully Jun 03 11:57:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad16a562-5fe4-47f5-944d-9a0095b8b8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Flow 'volume_create_manager' (9a12cf6f-dbd5-4c03-ba0a-17dd91b0c126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:57:37 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7100976-c11f-477f-a55a-e215b322f44c]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a6f515da-109f-46e3-a1dd-db9f1da8fefe tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:37 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-eeb815a4-58df-49d7-bf92-15e83d025793 tempest-GroupSnapshotsTest-1791220728 None] Created volume successfully. Jun 03 11:57:37 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5 Jun 03 11:57:37 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:37 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.865s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:37 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:57:37 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.870a22c6-1139-4ab7-91ef-6ece981de6c4" returned: 0 in 1.073s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.870a22c6-1139-4ab7-91ef-6ece981de6c4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:37 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.870a22c6-1139-4ab7-91ef-6ece981de6c4 Jun 03 11:57:37 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:38 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a6f515da-109f-46e3-a1dd-db9f1da8fefe tempest-VolumesExtendTest-1403756257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5" returned: 0 in 0.876s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a6f515da-109f-46e3-a1dd-db9f1da8fefe tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:38 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604 1G Jun 03 11:57:38 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:38 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.870a22c6-1139-4ab7-91ef-6ece981de6c4" returned: 0 in 0.671s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:38 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-quobyte-870a22c6-1139-4ab7-91ef-6ece981de6c4" released by "_delete_snapshot" :: held 3.803s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:38 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-quobyte-6e822c36-a896-4fc3-83b3-95dc2dd8915b" released by "delete_snapshot" :: held 3.837s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:38 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] Created reservations ['eb3afdc8-d323-41be-bdd5-063a78e00511', '2f1c6ac0-2c39-454e-8569-e44f887e7d95', '4a680543-99fa-4e3c-bec6-3cf211ec4462', '2d7b5ee8-32e3-4b67-8670-a97189aff0c1'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:57:38 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] Delete snapshot completed successfully. Jun 03 11:57:38 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-769e16f3-fa49-4657-a1b9-d7cf809df360 tempest-SnapshotsActionsTest-857471728 None] Lock "cinder-870a22c6-1139-4ab7-91ef-6ece981de6c4-delete_snapshot" released by "delete_snapshot" :: held 4.037s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:38 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a947c850-9b63-4ae5-9eab-5bfcc3c3931a tempest-GroupSnapshotsTest-1791220728 None] GroupSnapshot d08daf65-0f15-4b7b-8c3e-ae9507a52d3f: creating. Jun 03 11:57:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a947c850-9b63-4ae5-9eab-5bfcc3c3931a tempest-GroupSnapshotsTest-1791220728 None] Group snapshot d08daf65-0f15-4b7b-8c3e-ae9507a52d3f: creating. {{(pid=86724) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 03 11:57:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a947c850-9b63-4ae5-9eab-5bfcc3c3931a tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] Acquiring lock "cinder-3fdafb90-deb1-46d4-b28d-0a95553ba3fb-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] Lock "cinder-3fdafb90-deb1-46d4-b28d-0a95553ba3fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] Acquiring lock "cinder-quobyte-6e822c36-a896-4fc3-83b3-95dc2dd8915b" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:39 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] Lock "cinder-quobyte-6e822c36-a896-4fc3-83b3-95dc2dd8915b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] Acquiring lock "cinder-quobyte-3fdafb90-deb1-46d4-b28d-0a95553ba3fb" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a6f515da-109f-46e3-a1dd-db9f1da8fefe tempest-VolumesExtendTest-1403756257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604 1G" returned: 0 in 1.025s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a6f515da-109f-46e3-a1dd-db9f1da8fefe tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32872244-76e0-4e96-aebe-1830c73562f5 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] Lock "cinder-quobyte-3fdafb90-deb1-46d4-b28d-0a95553ba3fb" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] Deleting offline snapshot 3fdafb90-deb1-46d4-b28d-0a95553ba3fb of volume 6e822c36-a896-4fc3-83b3-95dc2dd8915b {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 11:57:39 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32872244-76e0-4e96-aebe-1830c73562f5 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604 Jun 03 11:57:39 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] snapshot_file for this snap is: volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 11:57:39 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[658733e8-49a2-40db-ada0-3de0bac7573e]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:39 devstack sudo[95751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb Jun 03 11:57:39 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:40 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a6f515da-109f-46e3-a1dd-db9f1da8fefe tempest-VolumesExtendTest-1403756257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32872244-76e0-4e96-aebe-1830c73562f5 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604" returned: 0 in 0.688s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:40 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-a6f515da-109f-46e3-a1dd-db9f1da8fefe tempest-VolumesExtendTest-1403756257 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604 is being set with open permissions: ugo+rw Jun 03 11:57:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a6f515da-109f-46e3-a1dd-db9f1da8fefe tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:40 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604 Jun 03 11:57:40 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:40 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb" returned: 0 in 0.822s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:57:40 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23f0f45-1e9b-421c-bb9d-e8ba4abcdef7]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:40 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b Jun 03 11:57:40 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:40 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a6f515da-109f-46e3-a1dd-db9f1da8fefe tempest-VolumesExtendTest-1403756257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604" returned: 0 in 0.656s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a6f515da-109f-46e3-a1dd-db9f1da8fefe tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:40 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.info Jun 03 11:57:40 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:41 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b" returned: 0 in 0.768s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:41 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb Jun 03 11:57:41 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:41 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a6f515da-109f-46e3-a1dd-db9f1da8fefe tempest-VolumesExtendTest-1403756257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.info" returned: 0 in 0.663s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:41 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-a6f515da-109f-46e3-a1dd-db9f1da8fefe tempest-VolumesExtendTest-1403756257 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.info is being set with open permissions: ugo+rw Jun 03 11:57:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a6f515da-109f-46e3-a1dd-db9f1da8fefe tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:41 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.info Jun 03 11:57:41 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:41 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a90828e7-576d-4315-8636-85e8d87e73f9 tempest-GroupSnapshotsV319Test-1649754957 None] Group tempest-GroupSnapshotsV319Test-Group-71797907: creating Jun 03 11:57:41 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a90828e7-576d-4315-8636-85e8d87e73f9 tempest-GroupSnapshotsV319Test-1649754957 None] Group tempest-GroupSnapshotsV319Test-Group-71797907: created successfully Jun 03 11:57:41 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a90828e7-576d-4315-8636-85e8d87e73f9 tempest-GroupSnapshotsV319Test-1649754957 None] Create group completed successfully. Jun 03 11:57:41 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb" returned: 0 in 0.743s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:41 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb Jun 03 11:57:41 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:42 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a6f515da-109f-46e3-a1dd-db9f1da8fefe tempest-VolumesExtendTest-1403756257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.info" returned: 0 in 0.652s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a6f515da-109f-46e3-a1dd-db9f1da8fefe tempest-VolumesExtendTest-1403756257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.705s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a947c850-9b63-4ae5-9eab-5bfcc3c3931a tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.242s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-a947c850-9b63-4ae5-9eab-5bfcc3c3931a tempest-GroupSnapshotsTest-1791220728 None] Creating offline snapshot cde77a8b-5b11-42a9-95cf-2b71c0235aa0 of volume 85dc3fd8-03a7-4382-9fc6-de5e041c2fb2 {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 11:57:42 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a6f515da-109f-46e3-a1dd-db9f1da8fefe tempest-VolumesExtendTest-1403756257 None] Create snapshot completed successfully Jun 03 11:57:42 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c869f0-ac34-481e-8e17-d754a168d183]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a947c850-9b63-4ae5-9eab-5bfcc3c3931a tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:42 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2 Jun 03 11:57:42 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:42 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b.3fdafb90-deb1-46d4-b28d-0a95553ba3fb" returned: 0 in 0.611s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] Lock "cinder-quobyte-3fdafb90-deb1-46d4-b28d-0a95553ba3fb" released by "_delete_snapshot" :: held 3.102s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] Lock "cinder-quobyte-6e822c36-a896-4fc3-83b3-95dc2dd8915b" released by "delete_snapshot" :: held 3.142s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d232870f-f8ac-4020-b721-9a92fb8f5ba3 tempest-VolumesExtendTest-1403756257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:42 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] Created reservations ['4aa22e26-c71f-4854-a1b3-d285fcfad2ca', '3646fd61-112a-4621-9252-4068879a4b68', '2bb23f1a-8c4f-45a8-aea7-e67bc31f48b6', 'ff57d7ff-ca0b-40ea-b26f-6455f7498d1b'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:57:42 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] Delete snapshot completed successfully. Jun 03 11:57:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5660c406-28fc-405d-9a79-12df4dae6e1a tempest-SnapshotsActionsTest-893138396 None] Lock "cinder-3fdafb90-deb1-46d4-b28d-0a95553ba3fb-delete_snapshot" released by "delete_snapshot" :: held 3.311s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:42 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a947c850-9b63-4ae5-9eab-5bfcc3c3931a tempest-GroupSnapshotsTest-1791220728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2" returned: 0 in 0.779s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a947c850-9b63-4ae5-9eab-5bfcc3c3931a tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.cde77a8b-5b11-42a9-95cf-2b71c0235aa0 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:42 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.cde77a8b-5b11-42a9-95cf-2b71c0235aa0 1G Jun 03 11:57:42 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:43 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:57:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Flow 'volume_create_manager' (bd573305-1e9f-4281-a80f-0f5350c5391a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:57:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06096b04-52ac-48b8-8f47-c19b690268bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06096b04-52ac-48b8-8f47-c19b690268bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-821934440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e8997868-f5c9-475d-984f-ec7ffc347ded,host='devstack@QuobyteHD#QuobyteHD',id=011f20fe-0b2c-42fe-998e-67ee0e4d439d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b361462837a42fe98490c0e607474d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:57:43Z,use_quota=True,user_id='8f23215d04a9449f9b2a66bdef54ea00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e0bacac-ad79-400e-b253-a4e90eb48669),volume_type_id=9e0bacac-ad79-400e-b253-a4e90eb48669)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508cdfb9-a1ee-4a9d-82d9-3ad9f6741165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508cdfb9-a1ee-4a9d-82d9-3ad9f6741165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8ab77f-ab2f-4860-ba46-aaf6a116b317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8ab77f-ab2f-4860-ba46-aaf6a116b317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '011f20fe-0b2c-42fe-998e-67ee0e4d439d', 'volume_name': 'volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f4cdd9-2d14-417e-be7d-4f0113cb19c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f4cdd9-2d14-417e-be7d-4f0113cb19c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824d6321-0194-4e7d-9496-80bd96877946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:43 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Volume 011f20fe-0b2c-42fe-998e-67ee0e4d439d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d', 'volume_size': 1} Jun 03 11:57:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:43 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d69bbb36-6c77-4e5c-bac0-8a7fda45f807 tempest-SnapshotsActionsTest-893138396 None] Acquiring lock "cinder-6e822c36-a896-4fc3-83b3-95dc2dd8915b-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:43 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d69bbb36-6c77-4e5c-bac0-8a7fda45f807 tempest-SnapshotsActionsTest-893138396 None] Lock "cinder-6e822c36-a896-4fc3-83b3-95dc2dd8915b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:43 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d69bbb36-6c77-4e5c-bac0-8a7fda45f807 tempest-SnapshotsActionsTest-893138396 None] Acquiring lock "cinder-quobyte-6e822c36-a896-4fc3-83b3-95dc2dd8915b" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:43 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d69bbb36-6c77-4e5c-bac0-8a7fda45f807 tempest-SnapshotsActionsTest-893138396 None] Lock "cinder-quobyte-6e822c36-a896-4fc3-83b3-95dc2dd8915b" acquired by "delete_volume" :: waited 0.014s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:43 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[744b6484-0d48-475e-9c6e-3ab1e5e21487]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d69bbb36-6c77-4e5c-bac0-8a7fda45f807 tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:43 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a947c850-9b63-4ae5-9eab-5bfcc3c3931a tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.cde77a8b-5b11-42a9-95cf-2b71c0235aa0 1G" returned: 0 in 0.874s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a947c850-9b63-4ae5-9eab-5bfcc3c3931a tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.cde77a8b-5b11-42a9-95cf-2b71c0235aa0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:43 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.cde77a8b-5b11-42a9-95cf-2b71c0235aa0 Jun 03 11:57:43 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:43 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b Jun 03 11:57:43 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:44 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a947c850-9b63-4ae5-9eab-5bfcc3c3931a tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.cde77a8b-5b11-42a9-95cf-2b71c0235aa0" returned: 0 in 0.691s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:44 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-a947c850-9b63-4ae5-9eab-5bfcc3c3931a tempest-GroupSnapshotsTest-1791220728 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.cde77a8b-5b11-42a9-95cf-2b71c0235aa0 is being set with open permissions: ugo+rw: NotImplementedError Jun 03 11:57:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a947c850-9b63-4ae5-9eab-5bfcc3c3931a tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.cde77a8b-5b11-42a9-95cf-2b71c0235aa0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:44 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.cde77a8b-5b11-42a9-95cf-2b71c0235aa0 Jun 03 11:57:44 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:44 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d69bbb36-6c77-4e5c-bac0-8a7fda45f807 tempest-SnapshotsActionsTest-893138396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b" returned: 0 in 0.807s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d69bbb36-6c77-4e5c-bac0-8a7fda45f807 tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:44 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b Jun 03 11:57:44 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:45 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a947c850-9b63-4ae5-9eab-5bfcc3c3931a tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.cde77a8b-5b11-42a9-95cf-2b71c0235aa0" returned: 0 in 0.682s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:45 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d69bbb36-6c77-4e5c-bac0-8a7fda45f807 tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e822c36-a896-4fc3-83b3-95dc2dd8915b" returned: 0 in 0.617s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d69bbb36-6c77-4e5c-bac0-8a7fda45f807 tempest-SnapshotsActionsTest-893138396 None] Lock "cinder-quobyte-6e822c36-a896-4fc3-83b3-95dc2dd8915b" released by "delete_volume" :: held 1.495s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a947c850-9b63-4ae5-9eab-5bfcc3c3931a tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:45 devstack sudo[95813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.info Jun 03 11:57:45 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:45 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-d69bbb36-6c77-4e5c-bac0-8a7fda45f807 tempest-SnapshotsActionsTest-893138396 None] Created reservations ['353bd541-9baf-484e-9636-0d4571a42c57', '63bf0c75-ca81-42ce-ab0e-73d33d5d2a10', '692bcc73-5317-4bd9-af31-10c7a2ff02bf', '64aefad5-a3ac-4911-b74b-b62128c6bdf7'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:57:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d69bbb36-6c77-4e5c-bac0-8a7fda45f807 tempest-SnapshotsActionsTest-893138396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d69bbb36-6c77-4e5c-bac0-8a7fda45f807 tempest-SnapshotsActionsTest-893138396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d69bbb36-6c77-4e5c-bac0-8a7fda45f807 tempest-SnapshotsActionsTest-893138396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:57:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d69bbb36-6c77-4e5c-bac0-8a7fda45f807 tempest-SnapshotsActionsTest-893138396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:57:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d69bbb36-6c77-4e5c-bac0-8a7fda45f807 tempest-SnapshotsActionsTest-893138396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d69bbb36-6c77-4e5c-bac0-8a7fda45f807 tempest-SnapshotsActionsTest-893138396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:45 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:57:45 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:45 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a947c850-9b63-4ae5-9eab-5bfcc3c3931a tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.info" returned: 0 in 0.639s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:45 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-a947c850-9b63-4ae5-9eab-5bfcc3c3931a tempest-GroupSnapshotsTest-1791220728 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.info is being set with open permissions: ugo+rw: NotImplementedError Jun 03 11:57:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a947c850-9b63-4ae5-9eab-5bfcc3c3931a tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:45 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.info Jun 03 11:57:45 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:46 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d69bbb36-6c77-4e5c-bac0-8a7fda45f807 tempest-SnapshotsActionsTest-893138396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.672s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:46 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-d69bbb36-6c77-4e5c-bac0-8a7fda45f807 tempest-SnapshotsActionsTest-893138396 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:57:46 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d69bbb36-6c77-4e5c-bac0-8a7fda45f807 tempest-SnapshotsActionsTest-893138396 None] Deleted volume successfully. Jun 03 11:57:46 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d69bbb36-6c77-4e5c-bac0-8a7fda45f807 tempest-SnapshotsActionsTest-893138396 None] Lock "cinder-6e822c36-a896-4fc3-83b3-95dc2dd8915b-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:46 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a947c850-9b63-4ae5-9eab-5bfcc3c3931a tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.info" returned: 0 in 0.611s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a947c850-9b63-4ae5-9eab-5bfcc3c3931a tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.396s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d232870f-f8ac-4020-b721-9a92fb8f5ba3 tempest-VolumesExtendTest-1403756257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.953s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:46 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b6e87b-6676-4d49-b2b6-1fbb21917308]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d232870f-f8ac-4020-b721-9a92fb8f5ba3 tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:46 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a947c850-9b63-4ae5-9eab-5bfcc3c3931a tempest-GroupSnapshotsTest-1791220728 None] group_snapshot d08daf65-0f15-4b7b-8c3e-ae9507a52d3f: created successfully Jun 03 11:57:46 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5 Jun 03 11:57:46 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:47 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d232870f-f8ac-4020-b721-9a92fb8f5ba3 tempest-VolumesExtendTest-1403756257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5" returned: 0 in 0.784s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d232870f-f8ac-4020-b721-9a92fb8f5ba3 tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604 2G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:47 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] group_snapshot d08daf65-0f15-4b7b-8c3e-ae9507a52d3f: deleting Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] group_snapshot d08daf65-0f15-4b7b-8c3e-ae9507a52d3f: deleting {{(pid=86724) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "cinder-quobyte-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "cinder-quobyte-cde77a8b-5b11-42a9-95cf-2b71c0235aa0" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-cde77a8b-5b11-42a9-95cf-2b71c0235aa0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] Deleting offline snapshot cde77a8b-5b11-42a9-95cf-2b71c0235aa0 of volume 85dc3fd8-03a7-4382-9fc6-de5e041c2fb2 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] snapshot_file for this snap is: volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.cde77a8b-5b11-42a9-95cf-2b71c0235aa0 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e035bc3-0336-43ef-81fc-cdc137897803]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.cde77a8b-5b11-42a9-95cf-2b71c0235aa0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d232870f-f8ac-4020-b721-9a92fb8f5ba3 tempest-VolumesExtendTest-1403756257 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604 2G" returned: 0 in 0.203s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d232870f-f8ac-4020-b721-9a92fb8f5ba3 tempest-VolumesExtendTest-1403756257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.037s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.241s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e8997868-f5c9-475d-984f-ec7ffc347ded,created_at=2026-06-03T09:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-821934440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e8997868-f5c9-475d-984f-ec7ffc347ded,host='devstack@QuobyteHD#QuobyteHD',id=011f20fe-0b2c-42fe-998e-67ee0e4d439d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b361462837a42fe98490c0e607474d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:57:43Z,use_quota=True,user_id='8f23215d04a9449f9b2a66bdef54ea00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e0bacac-ad79-400e-b253-a4e90eb48669),volume_type_id=9e0bacac-ad79-400e-b253-a4e90eb48669)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Creating volume 011f20fe-0b2c-42fe-998e-67ee0e4d439d {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:57:47 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:57:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:47 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d 1073741824 Jun 03 11:57:47 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:47 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d232870f-f8ac-4020-b721-9a92fb8f5ba3 tempest-VolumesExtendTest-1403756257 None] Extend volume completed successfully. Jun 03 11:57:47 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.cde77a8b-5b11-42a9-95cf-2b71c0235aa0 Jun 03 11:57:47 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] Acquiring lock "cinder-731bfd56-5b00-4ba5-9ae9-e828717db604-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] Lock "cinder-731bfd56-5b00-4ba5-9ae9-e828717db604-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] Acquiring lock "cinder-quobyte-32872244-76e0-4e96-aebe-1830c73562f5" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] Lock "cinder-quobyte-32872244-76e0-4e96-aebe-1830c73562f5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] Acquiring lock "cinder-quobyte-731bfd56-5b00-4ba5-9ae9-e828717db604" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] Lock "cinder-quobyte-731bfd56-5b00-4ba5-9ae9-e828717db604" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:48 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] Deleting offline snapshot 731bfd56-5b00-4ba5-9ae9-e828717db604 of volume 32872244-76e0-4e96-aebe-1830c73562f5 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 11:57:48 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] snapshot_file for this snap is: volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 11:57:48 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[889852de-7eb2-411d-a314-e4814cf07449]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:48 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604 Jun 03 11:57:48 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:48 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.cde77a8b-5b11-42a9-95cf-2b71c0235aa0" returned: 0 in 0.945s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:48 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:57:48 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f00a7d-8a50-44d1-9730-2768a58e31bf]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:48 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d 1073741824" returned: 0 in 0.976s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:48 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d Jun 03 11:57:48 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:48 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2 Jun 03 11:57:48 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:49 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604" returned: 0 in 0.852s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32872244-76e0-4e96-aebe-1830c73562f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:57:49 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8908d5cd-853c-4159-9527-7045b54eb1a7]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:49 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5 Jun 03 11:57:49 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:49 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2" returned: 0 in 0.861s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.cde77a8b-5b11-42a9-95cf-2b71c0235aa0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:49 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d" returned: 0 in 0.798s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:57:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:49 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.cde77a8b-5b11-42a9-95cf-2b71c0235aa0 Jun 03 11:57:49 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824d6321-0194-4e7d-9496-80bd96877946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d691a33-6987-4c1e-9aa8-e794bede2896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:49 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Volume volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d (011f20fe-0b2c-42fe-998e-67ee0e4d439d): created successfully Jun 03 11:57:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d691a33-6987-4c1e-9aa8-e794bede2896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Flow 'volume_create_manager' (bd573305-1e9f-4281-a80f-0f5350c5391a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:57:49 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-81f7eb27-d4ce-45b3-a53b-daea70852cf1 tempest-GroupSnapshotsV319Test-1649754957 None] Created volume successfully. Jun 03 11:57:50 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5" returned: 0 in 0.875s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:50 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604 Jun 03 11:57:50 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:50 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-729b5447-97bb-4715-afe0-44d59b6676a3 tempest-GroupSnapshotsV319Test-1649754957 None] GroupSnapshot b8619dbd-58ee-4969-a0cd-f53aa6d8b0c0: creating. Jun 03 11:57:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-729b5447-97bb-4715-afe0-44d59b6676a3 tempest-GroupSnapshotsV319Test-1649754957 None] Group snapshot b8619dbd-58ee-4969-a0cd-f53aa6d8b0c0: creating. {{(pid=86724) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 03 11:57:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-729b5447-97bb-4715-afe0-44d59b6676a3 tempest-GroupSnapshotsV319Test-1649754957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-729b5447-97bb-4715-afe0-44d59b6676a3 tempest-GroupSnapshotsV319Test-1649754957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:50 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.cde77a8b-5b11-42a9-95cf-2b71c0235aa0" returned: 0 in 0.914s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.cde77a8b-5b11-42a9-95cf-2b71c0235aa0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:50 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-729b5447-97bb-4715-afe0-44d59b6676a3 tempest-GroupSnapshotsV319Test-1649754957 None] Creating offline snapshot 264f491e-9858-42f8-96ad-c3a4ee1ed248 of volume 011f20fe-0b2c-42fe-998e-67ee0e4d439d {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 11:57:50 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.cde77a8b-5b11-42a9-95cf-2b71c0235aa0 Jun 03 11:57:50 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:50 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7764c9eb-45c2-4dcc-b819-f20337d51c9b]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-729b5447-97bb-4715-afe0-44d59b6676a3 tempest-GroupSnapshotsV319Test-1649754957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:50 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d Jun 03 11:57:50 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:50 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604" returned: 0 in 0.956s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:51 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604 Jun 03 11:57:51 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:51 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2.cde77a8b-5b11-42a9-95cf-2b71c0235aa0" returned: 0 in 0.777s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:51 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-cde77a8b-5b11-42a9-95cf-2b71c0235aa0" released by "_delete_snapshot" :: held 3.650s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:51 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2" released by "delete_snapshot" :: held 3.686s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:51 devstack cinder-volume[86724]: WARNING cinder.quota [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1786491258 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1786491258, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:57:51 devstack cinder-volume[86724]: WARNING cinder.quota [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1786491258 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1786491258, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:57:51 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] Created reservations ['147eccea-6d7f-4671-9b51-fba023eeb89d', '898479b7-9e1e-47bc-bf4f-369764f8c422', 'f7cdcd74-993d-47eb-a104-f0aa0e50f105', '826b4bbf-ba5a-4acc-8a71-cde80e1d107d'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:57:51 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-729b5447-97bb-4715-afe0-44d59b6676a3 tempest-GroupSnapshotsV319Test-1649754957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d" returned: 0 in 1.062s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-729b5447-97bb-4715-afe0-44d59b6676a3 tempest-GroupSnapshotsV319Test-1649754957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.264f491e-9858-42f8-96ad-c3a4ee1ed248 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:51 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.264f491e-9858-42f8-96ad-c3a4ee1ed248 1G Jun 03 11:57:51 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:51 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-b16ef947-3811-4142-8162-9d4856cb0b1e tempest-GroupSnapshotsTest-1791220728 None] group_snapshot d08daf65-0f15-4b7b-8c3e-ae9507a52d3f: deleted successfully Jun 03 11:57:51 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5.731bfd56-5b00-4ba5-9ae9-e828717db604" returned: 0 in 0.871s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:51 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] Lock "cinder-quobyte-731bfd56-5b00-4ba5-9ae9-e828717db604" released by "_delete_snapshot" :: held 3.690s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:51 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] Lock "cinder-quobyte-32872244-76e0-4e96-aebe-1830c73562f5" released by "delete_snapshot" :: held 3.720s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:51 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] Created reservations ['36fb4ac6-4d15-4c9a-aa82-125abbfc64b5', '7b115034-e717-4eaf-a216-771e7bbff8c2', 'ce3df079-2adb-41c2-9ea4-253f71efb5f0', '49f026ee-8d82-4fa4-8328-460940400736'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:57:52 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] Delete snapshot completed successfully. Jun 03 11:57:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-f309dd6a-5850-4c95-95bb-a2d906379bc9 tempest-VolumesExtendTest-1403756257 None] Lock "cinder-731bfd56-5b00-4ba5-9ae9-e828717db604-delete_snapshot" released by "delete_snapshot" :: held 3.874s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-782b9ea2-127a-40c4-af95-fe64ff76c901 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "cinder-quobyte-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-782b9ea2-127a-40c4-af95-fe64ff76c901 tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2" acquired by "delete_volume" :: waited 0.016s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:52 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5823180b-b4d2-42c1-9ffc-3e607fb53781]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-782b9ea2-127a-40c4-af95-fe64ff76c901 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:52 devstack sudo[95929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2 Jun 03 11:57:52 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:52 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-729b5447-97bb-4715-afe0-44d59b6676a3 tempest-GroupSnapshotsV319Test-1649754957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.264f491e-9858-42f8-96ad-c3a4ee1ed248 1G" returned: 0 in 0.885s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-729b5447-97bb-4715-afe0-44d59b6676a3 tempest-GroupSnapshotsV319Test-1649754957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.264f491e-9858-42f8-96ad-c3a4ee1ed248 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:52 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.264f491e-9858-42f8-96ad-c3a4ee1ed248 Jun 03 11:57:52 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1a1ad36c-7de1-4bb7-92a9-dacf27ac398a tempest-VolumesExtendTest-1403756257 None] Acquiring lock "cinder-32872244-76e0-4e96-aebe-1830c73562f5-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1a1ad36c-7de1-4bb7-92a9-dacf27ac398a tempest-VolumesExtendTest-1403756257 None] Lock "cinder-32872244-76e0-4e96-aebe-1830c73562f5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1a1ad36c-7de1-4bb7-92a9-dacf27ac398a tempest-VolumesExtendTest-1403756257 None] Acquiring lock "cinder-quobyte-32872244-76e0-4e96-aebe-1830c73562f5" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1a1ad36c-7de1-4bb7-92a9-dacf27ac398a tempest-VolumesExtendTest-1403756257 None] Lock "cinder-quobyte-32872244-76e0-4e96-aebe-1830c73562f5" acquired by "delete_volume" :: waited 0.017s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:52 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46696f4-f482-4df6-bdb9-a9e71458a021]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1a1ad36c-7de1-4bb7-92a9-dacf27ac398a tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:52 devstack sudo[95934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5 Jun 03 11:57:52 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:52 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-782b9ea2-127a-40c4-af95-fe64ff76c901 tempest-GroupSnapshotsTest-1791220728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2" returned: 0 in 0.797s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-782b9ea2-127a-40c4-af95-fe64ff76c901 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:52 devstack sudo[95943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2 Jun 03 11:57:52 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:52 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-729b5447-97bb-4715-afe0-44d59b6676a3 tempest-GroupSnapshotsV319Test-1649754957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.264f491e-9858-42f8-96ad-c3a4ee1ed248" returned: 0 in 0.688s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:52 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-729b5447-97bb-4715-afe0-44d59b6676a3 tempest-GroupSnapshotsV319Test-1649754957 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.264f491e-9858-42f8-96ad-c3a4ee1ed248 is being set with open permissions: ugo+rw: NotImplementedError Jun 03 11:57:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-729b5447-97bb-4715-afe0-44d59b6676a3 tempest-GroupSnapshotsV319Test-1649754957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.264f491e-9858-42f8-96ad-c3a4ee1ed248 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:53 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.264f491e-9858-42f8-96ad-c3a4ee1ed248 Jun 03 11:57:53 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:53 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1a1ad36c-7de1-4bb7-92a9-dacf27ac398a tempest-VolumesExtendTest-1403756257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5" returned: 0 in 0.854s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1a1ad36c-7de1-4bb7-92a9-dacf27ac398a tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:53 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5 Jun 03 11:57:53 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:53 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-782b9ea2-127a-40c4-af95-fe64ff76c901 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2" returned: 0 in 0.676s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:53 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-782b9ea2-127a-40c4-af95-fe64ff76c901 tempest-GroupSnapshotsTest-1791220728 None] Lock "cinder-quobyte-85dc3fd8-03a7-4382-9fc6-de5e041c2fb2" released by "delete_volume" :: held 1.556s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:53 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-729b5447-97bb-4715-afe0-44d59b6676a3 tempest-GroupSnapshotsV319Test-1649754957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.264f491e-9858-42f8-96ad-c3a4ee1ed248" returned: 0 in 0.724s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-729b5447-97bb-4715-afe0-44d59b6676a3 tempest-GroupSnapshotsV319Test-1649754957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:53 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-782b9ea2-127a-40c4-af95-fe64ff76c901 tempest-GroupSnapshotsTest-1791220728 None] Created reservations ['8ec98823-aaaa-4d41-9e4e-6a9fa559de97'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:57:53 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.info Jun 03 11:57:53 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:53 devstack cinder-volume[86724]: WARNING cinder.quota [None req-782b9ea2-127a-40c4-af95-fe64ff76c901 tempest-GroupSnapshotsTest-1791220728 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1786491258 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1786491258, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:57:53 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-782b9ea2-127a-40c4-af95-fe64ff76c901 tempest-GroupSnapshotsTest-1791220728 None] Created reservations ['b7e6d3a0-5ba1-44e7-b506-72ec9ffe9a19', '9b2787f7-8acc-4567-9158-d3d41fdab98e', 'ad3174a1-92f8-45de-b864-36a80717627b', '6a4126c8-956a-4434-ad56-f3e925d67327'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:57:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-782b9ea2-127a-40c4-af95-fe64ff76c901 tempest-GroupSnapshotsTest-1791220728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-782b9ea2-127a-40c4-af95-fe64ff76c901 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:54 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-782b9ea2-127a-40c4-af95-fe64ff76c901 tempest-GroupSnapshotsTest-1791220728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:57:54 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-782b9ea2-127a-40c4-af95-fe64ff76c901 tempest-GroupSnapshotsTest-1791220728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:57:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-782b9ea2-127a-40c4-af95-fe64ff76c901 tempest-GroupSnapshotsTest-1791220728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-782b9ea2-127a-40c4-af95-fe64ff76c901 tempest-GroupSnapshotsTest-1791220728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:54 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:57:54 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:54 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1a1ad36c-7de1-4bb7-92a9-dacf27ac398a tempest-VolumesExtendTest-1403756257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-32872244-76e0-4e96-aebe-1830c73562f5" returned: 0 in 0.708s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1a1ad36c-7de1-4bb7-92a9-dacf27ac398a tempest-VolumesExtendTest-1403756257 None] Lock "cinder-quobyte-32872244-76e0-4e96-aebe-1830c73562f5" released by "delete_volume" :: held 1.631s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:54 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-1a1ad36c-7de1-4bb7-92a9-dacf27ac398a tempest-VolumesExtendTest-1403756257 None] Created reservations ['2110e60a-99ed-4386-8d6b-2a12e00dcd43', '14c26ce3-fd51-4023-baad-6b4608cf4bf6', 'be3a8a60-482b-41e0-8106-483d35f14629', '8547388d-119a-4c07-bd02-4844a755d0af'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:57:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1a1ad36c-7de1-4bb7-92a9-dacf27ac398a tempest-VolumesExtendTest-1403756257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1a1ad36c-7de1-4bb7-92a9-dacf27ac398a tempest-VolumesExtendTest-1403756257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:54 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1a1ad36c-7de1-4bb7-92a9-dacf27ac398a tempest-VolumesExtendTest-1403756257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:57:54 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1a1ad36c-7de1-4bb7-92a9-dacf27ac398a tempest-VolumesExtendTest-1403756257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:57:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1a1ad36c-7de1-4bb7-92a9-dacf27ac398a tempest-VolumesExtendTest-1403756257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1a1ad36c-7de1-4bb7-92a9-dacf27ac398a tempest-VolumesExtendTest-1403756257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:54 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:57:54 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:54 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-729b5447-97bb-4715-afe0-44d59b6676a3 tempest-GroupSnapshotsV319Test-1649754957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.info" returned: 0 in 0.768s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:54 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-729b5447-97bb-4715-afe0-44d59b6676a3 tempest-GroupSnapshotsV319Test-1649754957 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.info is being set with open permissions: ugo+rw: NotImplementedError Jun 03 11:57:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-729b5447-97bb-4715-afe0-44d59b6676a3 tempest-GroupSnapshotsV319Test-1649754957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:54 devstack sudo[95963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.info Jun 03 11:57:54 devstack sudo[95963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:54 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-782b9ea2-127a-40c4-af95-fe64ff76c901 tempest-GroupSnapshotsTest-1791220728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.689s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:54 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-782b9ea2-127a-40c4-af95-fe64ff76c901 tempest-GroupSnapshotsTest-1791220728 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:57:54 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-782b9ea2-127a-40c4-af95-fe64ff76c901 tempest-GroupSnapshotsTest-1791220728 None] Delete group completed successfully. Jun 03 11:57:55 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1a1ad36c-7de1-4bb7-92a9-dacf27ac398a tempest-VolumesExtendTest-1403756257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.731s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:55 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-1a1ad36c-7de1-4bb7-92a9-dacf27ac398a tempest-VolumesExtendTest-1403756257 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:57:55 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-1a1ad36c-7de1-4bb7-92a9-dacf27ac398a tempest-VolumesExtendTest-1403756257 None] Deleted volume successfully. Jun 03 11:57:55 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1a1ad36c-7de1-4bb7-92a9-dacf27ac398a tempest-VolumesExtendTest-1403756257 None] Lock "cinder-32872244-76e0-4e96-aebe-1830c73562f5-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:55 devstack sudo[95963]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-729b5447-97bb-4715-afe0-44d59b6676a3 tempest-GroupSnapshotsV319Test-1649754957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.info" returned: 0 in 0.850s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-729b5447-97bb-4715-afe0-44d59b6676a3 tempest-GroupSnapshotsV319Test-1649754957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.112s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:55 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-729b5447-97bb-4715-afe0-44d59b6676a3 tempest-GroupSnapshotsV319Test-1649754957 None] group_snapshot b8619dbd-58ee-4969-a0cd-f53aa6d8b0c0: created successfully Jun 03 11:57:56 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] group_snapshot b8619dbd-58ee-4969-a0cd-f53aa6d8b0c0: deleting Jun 03 11:57:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] group_snapshot b8619dbd-58ee-4969-a0cd-f53aa6d8b0c0: deleting {{(pid=86724) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 03 11:57:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] Acquiring lock "cinder-quobyte-011f20fe-0b2c-42fe-998e-67ee0e4d439d" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] Lock "cinder-quobyte-011f20fe-0b2c-42fe-998e-67ee0e4d439d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] Acquiring lock "cinder-quobyte-264f491e-9858-42f8-96ad-c3a4ee1ed248" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:57:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] Lock "cinder-quobyte-264f491e-9858-42f8-96ad-c3a4ee1ed248" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:57:56 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] Deleting offline snapshot 264f491e-9858-42f8-96ad-c3a4ee1ed248 of volume 011f20fe-0b2c-42fe-998e-67ee0e4d439d {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 11:57:56 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] snapshot_file for this snap is: volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.264f491e-9858-42f8-96ad-c3a4ee1ed248 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 11:57:56 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f74760-66a3-4d4e-9763-c11fb60e4e92]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.264f491e-9858-42f8-96ad-c3a4ee1ed248 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:56 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.264f491e-9858-42f8-96ad-c3a4ee1ed248 Jun 03 11:57:56 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:57 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.264f491e-9858-42f8-96ad-c3a4ee1ed248" returned: 0 in 0.854s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:57 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:57:57 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b41bf6-0760-4923-a6f2-0a931d885213]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:57:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:57 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d Jun 03 11:57:57 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:58 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d" returned: 0 in 0.959s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.264f491e-9858-42f8-96ad-c3a4ee1ed248 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:58 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.264f491e-9858-42f8-96ad-c3a4ee1ed248 Jun 03 11:57:58 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:59 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.264f491e-9858-42f8-96ad-c3a4ee1ed248" returned: 0 in 0.949s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.264f491e-9858-42f8-96ad-c3a4ee1ed248 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:59 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.264f491e-9858-42f8-96ad-c3a4ee1ed248 Jun 03 11:57:59 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Flow 'volume_create_manager' (875f5fe9-50a1-4079-aabb-f3088552010d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5748c2d-fd6d-44e8-9aab-9a278651d0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5748c2d-fd6d-44e8-9aab-9a278651d0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-301026316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fec822b9-0851-439f-b167-c4793260bf9d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bfef256f739b47e0bcb9b08633c1941e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:57:59Z,use_quota=True,user_id='47d9db5178db42108b039a2b7d0dc2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d015a086-2dbf-4e0e-9d5a-e5ed125de74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d015a086-2dbf-4e0e-9d5a-e5ed125de74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2ba9cf-47e3-42d9-8739-2f3df2537df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2ba9cf-47e3-42d9-8739-2f3df2537df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fec822b9-0851-439f-b167-c4793260bf9d', 'volume_name': 'volume-fec822b9-0851-439f-b167-c4793260bf9d', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249f999d-0cd5-4a48-ae0f-1e9fd955e6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249f999d-0cd5-4a48-ae0f-1e9fd955e6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b584241-29d1-4156-8651-d1e80d721f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:57:59 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Volume fec822b9-0851-439f-b167-c4793260bf9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fec822b9-0851-439f-b167-c4793260bf9d', 'volume_size': 1} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-301026316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fec822b9-0851-439f-b167-c4793260bf9d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bfef256f739b47e0bcb9b08633c1941e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:57:59Z,use_quota=True,user_id='47d9db5178db42108b039a2b7d0dc2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Creating volume fec822b9-0851-439f-b167-c4793260bf9d {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:57:59 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fec822b9-0851-439f-b167-c4793260bf9d 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:57:59 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fec822b9-0851-439f-b167-c4793260bf9d 1073741824 Jun 03 11:57:59 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:57:59 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d.264f491e-9858-42f8-96ad-c3a4ee1ed248" returned: 0 in 0.790s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] Lock "cinder-quobyte-264f491e-9858-42f8-96ad-c3a4ee1ed248" released by "_delete_snapshot" :: held 3.713s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:57:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] Lock "cinder-quobyte-011f20fe-0b2c-42fe-998e-67ee0e4d439d" released by "delete_snapshot" :: held 3.753s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:00 devstack cinder-volume[86724]: WARNING cinder.quota [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1465318917 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1465318917, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:58:00 devstack cinder-volume[86724]: WARNING cinder.quota [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1465318917 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1465318917, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:58:00 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] Created reservations ['310e6a45-d8e0-422d-b3a6-d83fee166a32', 'a32918ee-8931-4388-b8b8-d59a528ac44e', '8cb88ccb-430b-4c90-936d-10882a652b57', 'ddde7f57-3c15-4c30-ac05-3c5e1588d9af'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:58:00 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-5ba9e49a-0e3d-4384-808c-8847d9e94d26 tempest-GroupSnapshotsV319Test-1649754957 None] group_snapshot b8619dbd-58ee-4969-a0cd-f53aa6d8b0c0: deleted successfully Jun 03 11:58:00 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fec822b9-0851-439f-b167-c4793260bf9d 1073741824" returned: 0 in 0.961s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fec822b9-0851-439f-b167-c4793260bf9d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:00 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fec822b9-0851-439f-b167-c4793260bf9d Jun 03 11:58:00 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c377091d-e0c2-4373-a99e-052a0f9fa7c2 tempest-GroupSnapshotsV319Test-1649754957 None] Acquiring lock "cinder-quobyte-011f20fe-0b2c-42fe-998e-67ee0e4d439d" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c377091d-e0c2-4373-a99e-052a0f9fa7c2 tempest-GroupSnapshotsV319Test-1649754957 None] Lock "cinder-quobyte-011f20fe-0b2c-42fe-998e-67ee0e4d439d" acquired by "delete_volume" :: waited 0.025s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:00 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[96449a39-c79b-4c48-8976-1ede0647295e]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c377091d-e0c2-4373-a99e-052a0f9fa7c2 tempest-GroupSnapshotsV319Test-1649754957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:01 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d Jun 03 11:58:01 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:01 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fec822b9-0851-439f-b167-c4793260bf9d" returned: 0 in 0.827s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b584241-29d1-4156-8651-d1e80d721f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fec822b9-0851-439f-b167-c4793260bf9d', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8bd7a7-b298-4b88-b0a5-b15d725a1591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:01 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Volume volume-fec822b9-0851-439f-b167-c4793260bf9d (fec822b9-0851-439f-b167-c4793260bf9d): created successfully Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8bd7a7-b298-4b88-b0a5-b15d725a1591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Flow 'volume_create_manager' (875f5fe9-50a1-4079-aabb-f3088552010d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:01 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-99fa0a98-bf9a-4cfc-8100-0b0e8d9309cc tempest-VolumesGetTest-1657425241 None] Created volume successfully. Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Flow 'volume_create_manager' (bb94b3df-d728-4723-9786-6bc172a05c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36a8df2-c922-480f-a6d5-0ecf82075394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36a8df2-c922-480f-a6d5-0ecf82075394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-875527606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10dd070c-6bc5-4be9-a5b0-f98bd625f5b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d9f275150c44718a54b877c336f108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:02Z,use_quota=True,user_id='6af9d209311341d48dd5e58c916c6d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10059eb6-68a2-4fcb-b815-6489926ee628),volume_type_id=10059eb6-68a2-4fcb-b815-6489926ee628)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d49e22d-6ddc-4fb5-962f-545a20d00056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d49e22d-6ddc-4fb5-962f-545a20d00056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e9375db-7d4c-4d1c-8f0f-57402a17ca88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e9375db-7d4c-4d1c-8f0f-57402a17ca88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10dd070c-6bc5-4be9-a5b0-f98bd625f5b0', 'volume_name': 'volume-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55371884-1b6c-417f-b6b8-e11fb12dddad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55371884-1b6c-417f-b6b8-e11fb12dddad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297e1707-91b4-4bb0-b26f-ab1774403e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:01 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Volume 10dd070c-6bc5-4be9-a5b0-f98bd625f5b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0', 'volume_size': 1} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-875527606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10dd070c-6bc5-4be9-a5b0-f98bd625f5b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d9f275150c44718a54b877c336f108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:02Z,use_quota=True,user_id='6af9d209311341d48dd5e58c916c6d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10059eb6-68a2-4fcb-b815-6489926ee628),volume_type_id=10059eb6-68a2-4fcb-b815-6489926ee628)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Creating volume 10dd070c-6bc5-4be9-a5b0-f98bd625f5b0 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:58:01 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c377091d-e0c2-4373-a99e-052a0f9fa7c2 tempest-GroupSnapshotsV319Test-1649754957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d" returned: 0 in 1.001s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:01 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c377091d-e0c2-4373-a99e-052a0f9fa7c2 tempest-GroupSnapshotsV319Test-1649754957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:01 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0 1073741824 Jun 03 11:58:01 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:02 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d Jun 03 11:58:02 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:02 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:58:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Flow 'volume_create_manager' (4e849f95-614f-4116-80c4-da2fb9d97a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4813f6-7f2e-4537-bce3-1be06fe58fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4813f6-7f2e-4537-bce3-1be06fe58fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-407089530',display_name='tempest-VolumesGetTest-Volume-798782548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36e81e7-59af-4065-9b86-64cad84ee40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfef256f739b47e0bcb9b08633c1941e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:02Z,use_quota=True,user_id='47d9db5178db42108b039a2b7d0dc2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0eb2c4-bcca-48b1-a39b-e4f0e2d382f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0eb2c4-bcca-48b1-a39b-e4f0e2d382f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa5662f-0231-40e4-8683-9da2c74b26a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa5662f-0231-40e4-8683-9da2c74b26a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd36e81e7-59af-4065-9b86-64cad84ee40d', 'volume_name': 'volume-d36e81e7-59af-4065-9b86-64cad84ee40d', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd7de73-867b-4157-8c8b-d071814b9b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd7de73-867b-4157-8c8b-d071814b9b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf12956-6b76-4787-8d6b-9842738884aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:02 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Volume d36e81e7-59af-4065-9b86-64cad84ee40d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d36e81e7-59af-4065-9b86-64cad84ee40d', 'volume_size': 1} Jun 03 11:58:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:02 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c377091d-e0c2-4373-a99e-052a0f9fa7c2 tempest-GroupSnapshotsV319Test-1649754957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-011f20fe-0b2c-42fe-998e-67ee0e4d439d" returned: 0 in 0.788s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:02 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c377091d-e0c2-4373-a99e-052a0f9fa7c2 tempest-GroupSnapshotsV319Test-1649754957 None] Lock "cinder-quobyte-011f20fe-0b2c-42fe-998e-67ee0e4d439d" released by "delete_volume" :: held 1.904s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:02 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-c377091d-e0c2-4373-a99e-052a0f9fa7c2 tempest-GroupSnapshotsV319Test-1649754957 None] Created reservations ['bc7c2dd7-5169-40ba-b128-36cf0fa8a632'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:58:02 devstack cinder-volume[86724]: WARNING cinder.quota [None req-c377091d-e0c2-4373-a99e-052a0f9fa7c2 tempest-GroupSnapshotsV319Test-1649754957 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1465318917 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1465318917, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:58:02 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-c377091d-e0c2-4373-a99e-052a0f9fa7c2 tempest-GroupSnapshotsV319Test-1649754957 None] Created reservations ['ead33a46-fe8b-4e9b-a1fd-73f6cfc93ed0', '407b9f1e-8c06-4508-95b2-fd09bd780397', '07be9290-c234-4786-80e6-8e6904911c3b', 'dfdca475-4664-4244-8b27-5d1b9d9bc4a0'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:58:02 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0 1073741824" returned: 0 in 1.045s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c377091d-e0c2-4373-a99e-052a0f9fa7c2 tempest-GroupSnapshotsV319Test-1649754957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c377091d-e0c2-4373-a99e-052a0f9fa7c2 tempest-GroupSnapshotsV319Test-1649754957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c377091d-e0c2-4373-a99e-052a0f9fa7c2 tempest-GroupSnapshotsV319Test-1649754957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:03 devstack sudo[96017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0 Jun 03 11:58:03 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c377091d-e0c2-4373-a99e-052a0f9fa7c2 tempest-GroupSnapshotsV319Test-1649754957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c377091d-e0c2-4373-a99e-052a0f9fa7c2 tempest-GroupSnapshotsV319Test-1649754957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c377091d-e0c2-4373-a99e-052a0f9fa7c2 tempest-GroupSnapshotsV319Test-1649754957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:03 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:58:03 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:03 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0" returned: 0 in 0.702s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:03 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.292s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-407089530',display_name='tempest-VolumesGetTest-Volume-798782548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36e81e7-59af-4065-9b86-64cad84ee40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfef256f739b47e0bcb9b08633c1941e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:02Z,use_quota=True,user_id='47d9db5178db42108b039a2b7d0dc2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Creating volume d36e81e7-59af-4065-9b86-64cad84ee40d {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:58:03 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d36e81e7-59af-4065-9b86-64cad84ee40d 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c377091d-e0c2-4373-a99e-052a0f9fa7c2 tempest-GroupSnapshotsV319Test-1649754957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.708s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-c377091d-e0c2-4373-a99e-052a0f9fa7c2 tempest-GroupSnapshotsV319Test-1649754957 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:58:03 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c377091d-e0c2-4373-a99e-052a0f9fa7c2 tempest-GroupSnapshotsV319Test-1649754957 None] Delete group completed successfully. Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297e1707-91b4-4bb0-b26f-ab1774403e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e49cf682-90b7-41e9-951d-712ff0670b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:03 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d36e81e7-59af-4065-9b86-64cad84ee40d 1073741824 Jun 03 11:58:03 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:03 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Volume volume-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0 (10dd070c-6bc5-4be9-a5b0-f98bd625f5b0): created successfully Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e49cf682-90b7-41e9-951d-712ff0670b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:03 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Flow 'volume_create_manager' (bb94b3df-d728-4723-9786-6bc172a05c58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:03 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-3763b9ff-c1ab-4564-a4dc-9413b78997a4 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Created volume successfully. Jun 03 11:58:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b5626fb9-8759-42c0-97f6-ea65839c4978 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b5626fb9-8759-42c0-97f6-ea65839c4978 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:04 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b5626fb9-8759-42c0-97f6-ea65839c4978 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:04 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b5626fb9-8759-42c0-97f6-ea65839c4978 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b5626fb9-8759-42c0-97f6-ea65839c4978 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b5626fb9-8759-42c0-97f6-ea65839c4978 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:04 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:58:04 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:04 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d36e81e7-59af-4065-9b86-64cad84ee40d 1073741824" returned: 0 in 1.214s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d36e81e7-59af-4065-9b86-64cad84ee40d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:05 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d36e81e7-59af-4065-9b86-64cad84ee40d Jun 03 11:58:05 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:05 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b5626fb9-8759-42c0-97f6-ea65839c4978 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.849s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:05 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-b5626fb9-8759-42c0-97f6-ea65839c4978 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:58:05 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-b5626fb9-8759-42c0-97f6-ea65839c4978 tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Retype volume completed successfully. Jun 03 11:58:05 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d36e81e7-59af-4065-9b86-64cad84ee40d" returned: 0 in 0.890s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:58:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.158s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf12956-6b76-4787-8d6b-9842738884aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d36e81e7-59af-4065-9b86-64cad84ee40d', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a66fdb-f924-4829-af62-d6eec0fac8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:05 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Volume volume-d36e81e7-59af-4065-9b86-64cad84ee40d (d36e81e7-59af-4065-9b86-64cad84ee40d): created successfully Jun 03 11:58:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a66fdb-f924-4829-af62-d6eec0fac8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:06 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Flow 'volume_create_manager' (4e849f95-614f-4116-80c4-da2fb9d97a6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:06 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Acquiring lock "cinder-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:06 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-de977e66-b4bc-453f-ba2a-f9603ed24f44 tempest-VolumesGetTest-1657425241 None] Created volume successfully. Jun 03 11:58:06 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Lock "cinder-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:06 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Acquiring lock "cinder-quobyte-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:06 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Lock "cinder-quobyte-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0" acquired by "delete_volume" :: waited 0.023s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:06 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[06663bd4-8913-49e0-9f4d-a2ce2e532026]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:06 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0 Jun 03 11:58:06 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:06 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1e1a4a91-4c14-4f83-b4c1-d431b6dccfd9 tempest-VolumesGetTest-1657425241 None] Acquiring lock "cinder-d36e81e7-59af-4065-9b86-64cad84ee40d-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:06 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0" returned: 0 in 0.853s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:07 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0 Jun 03 11:58:07 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:07 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1e1a4a91-4c14-4f83-b4c1-d431b6dccfd9 tempest-VolumesGetTest-1657425241 None] Lock "cinder-d36e81e7-59af-4065-9b86-64cad84ee40d-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:07 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1e1a4a91-4c14-4f83-b4c1-d431b6dccfd9 tempest-VolumesGetTest-1657425241 None] Acquiring lock "cinder-quobyte-d36e81e7-59af-4065-9b86-64cad84ee40d" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:07 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1e1a4a91-4c14-4f83-b4c1-d431b6dccfd9 tempest-VolumesGetTest-1657425241 None] Lock "cinder-quobyte-d36e81e7-59af-4065-9b86-64cad84ee40d" acquired by "delete_volume" :: waited 0.028s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:07 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[215cf087-42ba-4527-bd9c-8342984c9db5]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e1a4a91-4c14-4f83-b4c1-d431b6dccfd9 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d36e81e7-59af-4065-9b86-64cad84ee40d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:07 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d36e81e7-59af-4065-9b86-64cad84ee40d Jun 03 11:58:07 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:07 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0" returned: 0 in 0.714s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:07 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Lock "cinder-quobyte-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0" released by "delete_volume" :: held 1.627s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:07 devstack cinder-volume[86724]: WARNING cinder.quota [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:58:07 devstack cinder-volume[86724]: WARNING cinder.quota [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:58:07 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Created reservations ['6c157a05-82c9-4c66-bbde-f38126262a16', '53b31c61-9585-4105-b559-7af08d77f28b', '6e978e0e-b7a6-435d-b21a-86790f6db1bc', 'e16a10d2-aed7-403b-92d6-32191ae9f68b'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:58:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:07 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:58:07 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:08 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e1a4a91-4c14-4f83-b4c1-d431b6dccfd9 tempest-VolumesGetTest-1657425241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d36e81e7-59af-4065-9b86-64cad84ee40d" returned: 0 in 0.825s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e1a4a91-4c14-4f83-b4c1-d431b6dccfd9 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d36e81e7-59af-4065-9b86-64cad84ee40d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:08 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d36e81e7-59af-4065-9b86-64cad84ee40d Jun 03 11:58:08 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:08 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.727s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:08 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:58:08 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Deleted volume successfully. Jun 03 11:58:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5a9b7744-c5a4-47e7-9ffc-8d75a90ec29b tempest-VolumeRetypeWithoutMigrationTest-1977534543 None] Lock "cinder-10dd070c-6bc5-4be9-a5b0-f98bd625f5b0-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:08 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e1a4a91-4c14-4f83-b4c1-d431b6dccfd9 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d36e81e7-59af-4065-9b86-64cad84ee40d" returned: 0 in 0.766s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1e1a4a91-4c14-4f83-b4c1-d431b6dccfd9 tempest-VolumesGetTest-1657425241 None] Lock "cinder-quobyte-d36e81e7-59af-4065-9b86-64cad84ee40d" released by "delete_volume" :: held 1.660s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:08 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-1e1a4a91-4c14-4f83-b4c1-d431b6dccfd9 tempest-VolumesGetTest-1657425241 None] Created reservations ['cc6e5c56-c744-4c32-806a-655acc9507bc', '7dba4801-54c3-477b-a978-21746f159179', 'c52c3296-6ea2-4bba-9f1e-8eb5ca25115e', '643ca891-bfd2-4f1c-ae31-1b0c726f4fb4'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:58:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1e1a4a91-4c14-4f83-b4c1-d431b6dccfd9 tempest-VolumesGetTest-1657425241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1e1a4a91-4c14-4f83-b4c1-d431b6dccfd9 tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1e1a4a91-4c14-4f83-b4c1-d431b6dccfd9 tempest-VolumesGetTest-1657425241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1e1a4a91-4c14-4f83-b4c1-d431b6dccfd9 tempest-VolumesGetTest-1657425241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1e1a4a91-4c14-4f83-b4c1-d431b6dccfd9 tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e1a4a91-4c14-4f83-b4c1-d431b6dccfd9 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:08 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:58:08 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-819a4eb9-1a83-41ff-afcb-c19e049be638 tempest-VolumesGetTest-1657425241 None] Acquiring lock "cinder-fec822b9-0851-439f-b167-c4793260bf9d-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-819a4eb9-1a83-41ff-afcb-c19e049be638 tempest-VolumesGetTest-1657425241 None] Lock "cinder-fec822b9-0851-439f-b167-c4793260bf9d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-819a4eb9-1a83-41ff-afcb-c19e049be638 tempest-VolumesGetTest-1657425241 None] Acquiring lock "cinder-quobyte-fec822b9-0851-439f-b167-c4793260bf9d" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-819a4eb9-1a83-41ff-afcb-c19e049be638 tempest-VolumesGetTest-1657425241 None] Lock "cinder-quobyte-fec822b9-0851-439f-b167-c4793260bf9d" acquired by "delete_volume" :: waited 0.026s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Flow 'volume_create_manager' (cabb22ab-58fa-4b0f-8f00-b6b9bcd770e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ca3157-1ef8-4687-93db-9fed14934a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50d6580-c4a0-4604-818f-79acb0baa486]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-819a4eb9-1a83-41ff-afcb-c19e049be638 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fec822b9-0851-439f-b167-c4793260bf9d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ca3157-1ef8-4687-93db-9fed14934a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-251760640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=811e92c1-7d65-42e5-b882-36d1e5b41457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7879b199b04b2fb3fb65f793b35cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:10Z,use_quota=True,user_id='9c02033335c0464f904f1e751004fa36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2eebc21-d20b-4656-a4a9-4261e20b4b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:09 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2eebc21-d20b-4656-a4a9-4261e20b4b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939c5682-c938-4873-b9dc-c1ed947b0cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939c5682-c938-4873-b9dc-c1ed947b0cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '811e92c1-7d65-42e5-b882-36d1e5b41457', 'volume_name': 'volume-811e92c1-7d65-42e5-b882-36d1e5b41457', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8d9ae6-669a-4c19-aa33-747c0fa2d7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8d9ae6-669a-4c19-aa33-747c0fa2d7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a40ef4e-0c34-410e-80f5-c8821f3f3736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:09 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Volume 811e92c1-7d65-42e5-b882-36d1e5b41457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-811e92c1-7d65-42e5-b882-36d1e5b41457', 'volume_size': 1} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-251760640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=811e92c1-7d65-42e5-b882-36d1e5b41457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7879b199b04b2fb3fb65f793b35cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:10Z,use_quota=True,user_id='9c02033335c0464f904f1e751004fa36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Creating volume 811e92c1-7d65-42e5-b882-36d1e5b41457 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:58:09 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-811e92c1-7d65-42e5-b882-36d1e5b41457 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e1a4a91-4c14-4f83-b4c1-d431b6dccfd9 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.888s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-1e1a4a91-4c14-4f83-b4c1-d431b6dccfd9 tempest-VolumesGetTest-1657425241 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:58:09 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-1e1a4a91-4c14-4f83-b4c1-d431b6dccfd9 tempest-VolumesGetTest-1657425241 None] Deleted volume successfully. Jun 03 11:58:09 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1e1a4a91-4c14-4f83-b4c1-d431b6dccfd9 tempest-VolumesGetTest-1657425241 None] Lock "cinder-d36e81e7-59af-4065-9b86-64cad84ee40d-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:09 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-811e92c1-7d65-42e5-b882-36d1e5b41457 1073741824 Jun 03 11:58:09 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:09 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fec822b9-0851-439f-b167-c4793260bf9d Jun 03 11:58:09 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:10 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-819a4eb9-1a83-41ff-afcb-c19e049be638 tempest-VolumesGetTest-1657425241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fec822b9-0851-439f-b167-c4793260bf9d" returned: 0 in 1.132s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-819a4eb9-1a83-41ff-afcb-c19e049be638 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fec822b9-0851-439f-b167-c4793260bf9d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:10 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fec822b9-0851-439f-b167-c4793260bf9d Jun 03 11:58:10 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:10 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-811e92c1-7d65-42e5-b882-36d1e5b41457 1073741824" returned: 0 in 1.151s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-811e92c1-7d65-42e5-b882-36d1e5b41457 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:11 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-811e92c1-7d65-42e5-b882-36d1e5b41457 Jun 03 11:58:11 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:11 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-819a4eb9-1a83-41ff-afcb-c19e049be638 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fec822b9-0851-439f-b167-c4793260bf9d" returned: 0 in 0.772s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:11 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-819a4eb9-1a83-41ff-afcb-c19e049be638 tempest-VolumesGetTest-1657425241 None] Lock "cinder-quobyte-fec822b9-0851-439f-b167-c4793260bf9d" released by "delete_volume" :: held 1.993s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:11 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-819a4eb9-1a83-41ff-afcb-c19e049be638 tempest-VolumesGetTest-1657425241 None] Created reservations ['79bb9536-59fd-4a76-926f-50fd13227ffc', '06ef6b5e-9663-4ef2-bc5a-b79bc8be2c0c', '873766cc-13ae-4740-b27f-53301f1fa774', '43c43e78-9457-453b-abf9-3d155b7619c1'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:58:11 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-811e92c1-7d65-42e5-b882-36d1e5b41457" returned: 0 in 0.754s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] <== create_volume: return (1996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:58:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.999s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a40ef4e-0c34-410e-80f5-c8821f3f3736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-811e92c1-7d65-42e5-b882-36d1e5b41457', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ddb865-5034-4c19-95e6-a0dde9e708b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:11 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Volume volume-811e92c1-7d65-42e5-b882-36d1e5b41457 (811e92c1-7d65-42e5-b882-36d1e5b41457): created successfully Jun 03 11:58:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ddb865-5034-4c19-95e6-a0dde9e708b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Flow 'volume_create_manager' (cabb22ab-58fa-4b0f-8f00-b6b9bcd770e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:11 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-5305dcbc-3283-4eba-80ff-8ba48229fcf5 tempest-VolumesListAdminTestJSON-1375266145 None] Created volume successfully. Jun 03 11:58:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-819a4eb9-1a83-41ff-afcb-c19e049be638 tempest-VolumesGetTest-1657425241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-819a4eb9-1a83-41ff-afcb-c19e049be638 tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-819a4eb9-1a83-41ff-afcb-c19e049be638 tempest-VolumesGetTest-1657425241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-819a4eb9-1a83-41ff-afcb-c19e049be638 tempest-VolumesGetTest-1657425241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-819a4eb9-1a83-41ff-afcb-c19e049be638 tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-819a4eb9-1a83-41ff-afcb-c19e049be638 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:11 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:58:11 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:12 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-819a4eb9-1a83-41ff-afcb-c19e049be638 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.667s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:12 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-819a4eb9-1a83-41ff-afcb-c19e049be638 tempest-VolumesGetTest-1657425241 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:58:12 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-819a4eb9-1a83-41ff-afcb-c19e049be638 tempest-VolumesGetTest-1657425241 None] Deleted volume successfully. Jun 03 11:58:12 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-819a4eb9-1a83-41ff-afcb-c19e049be638 tempest-VolumesGetTest-1657425241 None] Lock "cinder-fec822b9-0851-439f-b167-c4793260bf9d-delete_volume" released by "delete_volume" :: held 3.122s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Flow 'volume_create_manager' (9b2b4db4-a75f-4a77-ab9a-b0314b47162f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fea8f6a-8c5c-45c6-b5f1-7c0870aa8082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fea8f6a-8c5c-45c6-b5f1-7c0870aa8082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1803879856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c654b6-2f6f-4822-895d-b14f71e03269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfef256f739b47e0bcb9b08633c1941e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:13Z,use_quota=True,user_id='47d9db5178db42108b039a2b7d0dc2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2594fcbe-7e53-4439-a8a4-696a4709f830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2594fcbe-7e53-4439-a8a4-696a4709f830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd8e239-6024-495a-8802-3dcb2500a78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd8e239-6024-495a-8802-3dcb2500a78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3c654b6-2f6f-4822-895d-b14f71e03269', 'volume_name': 'volume-b3c654b6-2f6f-4822-895d-b14f71e03269', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df553de-773b-43f5-a34d-beb460afafc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df553de-773b-43f5-a34d-beb460afafc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48742885-70a7-4771-82dc-0d088a3d9507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:13 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Volume b3c654b6-2f6f-4822-895d-b14f71e03269: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3c654b6-2f6f-4822-895d-b14f71e03269', 'volume_size': 1} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1803879856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c654b6-2f6f-4822-895d-b14f71e03269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfef256f739b47e0bcb9b08633c1941e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:13Z,use_quota=True,user_id='47d9db5178db42108b039a2b7d0dc2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Creating volume b3c654b6-2f6f-4822-895d-b14f71e03269 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:58:13 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:13 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269 1073741824 Jun 03 11:58:13 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Flow 'volume_create_manager' (df7e843c-93df-423e-9cf0-be2f6e149b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b53baa0-e629-4528-b7f8-39c495efb2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b53baa0-e629-4528-b7f8-39c495efb2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1760326469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac43a29-9c79-43af-963d-5a5a2c53dae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7879b199b04b2fb3fb65f793b35cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:14Z,use_quota=True,user_id='9c02033335c0464f904f1e751004fa36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec652599-cc05-4bb8-90f6-aa1f4d6a572a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec652599-cc05-4bb8-90f6-aa1f4d6a572a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0f40b1-0da9-450e-b834-2ef9d6d6c32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0f40b1-0da9-450e-b834-2ef9d6d6c32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cac43a29-9c79-43af-963d-5a5a2c53dae3', 'volume_name': 'volume-cac43a29-9c79-43af-963d-5a5a2c53dae3', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73db3246-b257-4618-aafe-c8212e5a6dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73db3246-b257-4618-aafe-c8212e5a6dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bac6926-3585-4fbf-878c-64680c0d90e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:13 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Volume cac43a29-9c79-43af-963d-5a5a2c53dae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cac43a29-9c79-43af-963d-5a5a2c53dae3', 'volume_size': 1} Jun 03 11:58:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:14 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269 1073741824" returned: 0 in 0.932s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:14 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269 Jun 03 11:58:14 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:15 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269" returned: 0 in 0.700s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:58:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.549s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1760326469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac43a29-9c79-43af-963d-5a5a2c53dae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7879b199b04b2fb3fb65f793b35cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:14Z,use_quota=True,user_id='9c02033335c0464f904f1e751004fa36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:58:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Creating volume cac43a29-9c79-43af-963d-5a5a2c53dae3 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:58:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:58:15 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:58:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cac43a29-9c79-43af-963d-5a5a2c53dae3 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48742885-70a7-4771-82dc-0d088a3d9507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3c654b6-2f6f-4822-895d-b14f71e03269', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:15 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cac43a29-9c79-43af-963d-5a5a2c53dae3 1073741824 Jun 03 11:58:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de2f32a-f311-4aba-bcb8-d19d01d7036b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:15 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:15 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Volume volume-b3c654b6-2f6f-4822-895d-b14f71e03269 (b3c654b6-2f6f-4822-895d-b14f71e03269): created successfully Jun 03 11:58:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de2f32a-f311-4aba-bcb8-d19d01d7036b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Flow 'volume_create_manager' (9b2b4db4-a75f-4a77-ab9a-b0314b47162f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:15 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-4a791c82-0f89-434e-a3a8-801cd7983dbb tempest-VolumesGetTest-1657425241 None] Created volume successfully. Jun 03 11:58:16 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=182,cinder:INSERT=59,cinder:UPDATE=200,cinder:DELETE=10 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:58:16 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:58:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Flow 'volume_create_manager' (33e17bd6-e1f9-45cc-835d-3ba9e57c2ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5ff3b4-ddeb-4c15-9872-3904e36181cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5ff3b4-ddeb-4c15-9872-3904e36181cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1344072160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ce1df4-5f01-428d-8cec-02de7dadbc5f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bfef256f739b47e0bcb9b08633c1941e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b3c654b6-2f6f-4822-895d-b14f71e03269,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:16Z,use_quota=True,user_id='47d9db5178db42108b039a2b7d0dc2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b69c66-e005-4e39-8d0a-1bd32e7e7d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b69c66-e005-4e39-8d0a-1bd32e7e7d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f3d8a75-80bd-4a73-8b20-8fb8093074b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:16 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cac43a29-9c79-43af-963d-5a5a2c53dae3 1073741824" returned: 0 in 1.034s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f3d8a75-80bd-4a73-8b20-8fb8093074b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '65ce1df4-5f01-428d-8cec-02de7dadbc5f', 'volume_name': 'volume-65ce1df4-5f01-428d-8cec-02de7dadbc5f', 'volume_size': 1, 'source_volid': 'b3c654b6-2f6f-4822-895d-b14f71e03269', 'source_volstatus': 'available'}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8542a73f-1f9c-4de4-8d53-5e6723da6182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8542a73f-1f9c-4de4-8d53-5e6723da6182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2657ded-cfc4-4e41-882b-7807860c459a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:16 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Volume 65ce1df4-5f01-428d-8cec-02de7dadbc5f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-65ce1df4-5f01-428d-8cec-02de7dadbc5f', 'volume_size': 1, 'source_volid': 'b3c654b6-2f6f-4822-895d-b14f71e03269', 'source_volstatus': 'available'} Jun 03 11:58:16 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=179,cinder:INSERT=49,cinder:UPDATE=204,cinder:DELETE=11 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:58:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cac43a29-9c79-43af-963d-5a5a2c53dae3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:16 devstack sudo[96095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cac43a29-9c79-43af-963d-5a5a2c53dae3 Jun 03 11:58:16 devstack sudo[96095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:17 devstack sudo[96095]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cac43a29-9c79-43af-963d-5a5a2c53dae3" returned: 0 in 0.763s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:58:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.791s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:17 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Cloning volume b3c654b6-2f6f-4822-895d-b14f71e03269 to volume 65ce1df4-5f01-428d-8cec-02de7dadbc5f Jun 03 11:58:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bac6926-3585-4fbf-878c-64680c0d90e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cac43a29-9c79-43af-963d-5a5a2c53dae3', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73092c4-39d3-45ec-97b9-409e907b0a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:17 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Volume volume-cac43a29-9c79-43af-963d-5a5a2c53dae3 (cac43a29-9c79-43af-963d-5a5a2c53dae3): created successfully Jun 03 11:58:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73092c4-39d3-45ec-97b9-409e907b0a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Flow 'volume_create_manager' (df7e843c-93df-423e-9cf0-be2f6e149b84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Creating offline snapshot 9ea74708-a3cb-4b3b-9926-608dd1f2c388 of volume b3c654b6-2f6f-4822-895d-b14f71e03269 {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 11:58:17 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-7ae351ac-8fd1-4597-aabe-2b4f358681da tempest-VolumesListAdminTestJSON-1375266145 None] Created volume successfully. Jun 03 11:58:17 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9e0fb1-dcf6-4eb8-a35a-f10a97d00ba1]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:17 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269 Jun 03 11:58:17 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:18 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269" returned: 0 in 0.856s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:18 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388 1G Jun 03 11:58:18 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:18 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:58:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Flow 'volume_create_manager' (839986d3-bc88-4820-b27e-d8ff1decf604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac8c1a6-b529-4b20-a740-b793a8f14f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac8c1a6-b529-4b20-a740-b793a8f14f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1475251125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24fd2b41-185c-49c7-9f92-512b9f8b1a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7879b199b04b2fb3fb65f793b35cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:18Z,use_quota=True,user_id='9c02033335c0464f904f1e751004fa36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45fbc3dc-d749-4e50-8677-13ee717ccf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45fbc3dc-d749-4e50-8677-13ee717ccf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63f3202-e1bb-4e86-9733-77ebb4ccd44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63f3202-e1bb-4e86-9733-77ebb4ccd44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24fd2b41-185c-49c7-9f92-512b9f8b1a4b', 'volume_name': 'volume-24fd2b41-185c-49c7-9f92-512b9f8b1a4b', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8101d07-da53-47d5-894a-bc2550429d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8101d07-da53-47d5-894a-bc2550429d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73cb8ef-f47c-417e-a777-e3d819e99557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:18 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Volume 24fd2b41-185c-49c7-9f92-512b9f8b1a4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24fd2b41-185c-49c7-9f92-512b9f8b1a4b', 'volume_size': 1} Jun 03 11:58:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:19 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388 1G" returned: 0 in 1.069s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3c654b6-2f6f-4822-895d-b14f71e03269 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:19 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3c654b6-2f6f-4822-895d-b14f71e03269 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388 Jun 03 11:58:19 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:19 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3c654b6-2f6f-4822-895d-b14f71e03269 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388" returned: 0 in 0.763s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:19 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388 is being set with open permissions: ugo+rw Jun 03 11:58:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:19 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388 Jun 03 11:58:19 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:20 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388" returned: 0 in 0.731s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:20 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.info Jun 03 11:58:20 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:21 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.info" returned: 0 in 0.693s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:21 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.info is being set with open permissions: ugo+rw Jun 03 11:58:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:21 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.info Jun 03 11:58:21 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:22 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.info" returned: 0 in 0.676s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Acquiring lock "cinder-quobyte-65ce1df4-5f01-428d-8cec-02de7dadbc5f" by "_copy_volume_from_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Lock "cinder-quobyte-65ce1df4-5f01-428d-8cec-02de7dadbc5f" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] snapshot: 9ea74708-a3cb-4b3b-9926-608dd1f2c388, volume: 65ce1df4-5f01-428d-8cec-02de7dadbc5f, {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 11:58:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:22 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdeed9d-32cf-475e-985f-760036d64dc1]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:22 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388 Jun 03 11:58:22 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:23 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388" returned: 0 in 0.867s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:23 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3c654b6-2f6f-4822-895d-b14f71e03269(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:58:23 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] will copy from snapshot at /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269 {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 11:58:23 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Creating direct copy from snapshot {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 11:58:23 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6db818-b2a6-4abb-bf61-e90305511f94]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:23 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269 Jun 03 11:58:23 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:23 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-753829cc-cba5-42e6-b13e-5b1fecc57713 tempest-GroupsTest-1383947407 None] Group tempest-Group1-1531324619: creating Jun 03 11:58:23 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-753829cc-cba5-42e6-b13e-5b1fecc57713 tempest-GroupsTest-1383947407 None] Group tempest-Group1-1531324619: created successfully Jun 03 11:58:23 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-753829cc-cba5-42e6-b13e-5b1fecc57713 tempest-GroupsTest-1383947407 None] Create group completed successfully. Jun 03 11:58:23 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269" returned: 0 in 0.852s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:23 devstack cinder-volume[86724]: DEBUG cinder.utils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Path /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-65ce1df4-5f01-428d-8cec-02de7dadbc5f not found in is_blk_device check {{(pid=86724) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 03 11:58:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-65ce1df4-5f01-428d-8cec-02de7dadbc5f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:23 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-65ce1df4-5f01-428d-8cec-02de7dadbc5f Jun 03 11:58:23 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:24 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-7f09da9e-4ad7-42a9-afa7-c0addf01d455 tempest-GroupsTest-1383947407 None] Group tempest-Group2-1048109921: creating Jun 03 11:58:24 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-7f09da9e-4ad7-42a9-afa7-c0addf01d455 tempest-GroupsTest-1383947407 None] Group tempest-Group2-1048109921: created successfully Jun 03 11:58:24 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-7f09da9e-4ad7-42a9-afa7-c0addf01d455 tempest-GroupsTest-1383947407 None] Create group completed successfully. Jun 03 11:58:27 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:58:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Flow 'volume_create_manager' (ff46e946-27bb-4ff1-84c6-e5e92e1a6a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7d5b5d-20c9-4411-a849-a821b820aa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7d5b5d-20c9-4411-a849-a821b820aa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-67166285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7047d2c1-e4b4-4c0f-a04d-f78e9939306a,host='devstack@QuobyteHD#QuobyteHD',id=7bcb25a2-036e-4c66-8088-a4c00949dbc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae6c25e368047faa22c9fa58e460312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:27Z,use_quota=True,user_id='774d84014a384fbb8a495aa09c3f2608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab622fde-6568-4919-b2cb-cbcd5c89f7db),volume_type_id=ab622fde-6568-4919-b2cb-cbcd5c89f7db)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2024cb6d-597d-4436-8afa-f9ba08f0d419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2024cb6d-597d-4436-8afa-f9ba08f0d419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0970fe50-7609-46a4-a55c-4851dc755f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0970fe50-7609-46a4-a55c-4851dc755f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bcb25a2-036e-4c66-8088-a4c00949dbc8', 'volume_name': 'volume-7bcb25a2-036e-4c66-8088-a4c00949dbc8', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f923237-d0ad-4f05-98c8-b6254fa766f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f923237-d0ad-4f05-98c8-b6254fa766f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea56dbfe-741d-40f1-b0a0-9536610f39ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:27 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Volume 7bcb25a2-036e-4c66-8088-a4c00949dbc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bcb25a2-036e-4c66-8088-a4c00949dbc8', 'volume_size': 1} Jun 03 11:58:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:29 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-65ce1df4-5f01-428d-8cec-02de7dadbc5f" returned: 0 in 5.822s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:29 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9d2225-5268-4ddf-ab5d-e8c42d33ff89]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:29 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269 Jun 03 11:58:29 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:30 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269" returned: 0 in 0.985s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:30 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Image conversion details: src /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-65ce1df4-5f01-428d-8cec-02de7dadbc5f {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 11:58:30 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Converted 1024.00 MB image at 175.86 MB/s Jun 03 11:58:30 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-65ce1df4-5f01-428d-8cec-02de7dadbc5f is being set with open permissions: ugo+rw Jun 03 11:58:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-65ce1df4-5f01-428d-8cec-02de7dadbc5f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:30 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-65ce1df4-5f01-428d-8cec-02de7dadbc5f Jun 03 11:58:30 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:31 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-65ce1df4-5f01-428d-8cec-02de7dadbc5f" returned: 0 in 0.598s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:31 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Lock "cinder-quobyte-65ce1df4-5f01-428d-8cec-02de7dadbc5f" released by "_copy_volume_from_snapshot" :: held 9.232s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:31 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Acquiring lock "cinder-quobyte-9ea74708-a3cb-4b3b-9926-608dd1f2c388" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:31 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Lock "cinder-quobyte-9ea74708-a3cb-4b3b-9926-608dd1f2c388" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:31 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Deleting offline snapshot 9ea74708-a3cb-4b3b-9926-608dd1f2c388 of volume b3c654b6-2f6f-4822-895d-b14f71e03269 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 11:58:31 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] snapshot_file for this snap is: volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 11:58:31 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb606231-e547-4250-a717-a98a07933277]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:31 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388 Jun 03 11:58:31 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:32 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388" returned: 0 in 0.790s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:32 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3c654b6-2f6f-4822-895d-b14f71e03269(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:58:32 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da71748-930d-472c-9936-2af0dc0bfc9e]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:32 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269 Jun 03 11:58:32 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:32 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269" returned: 0 in 0.758s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:33 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388 Jun 03 11:58:33 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:33 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388" returned: 0 in 0.804s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:33 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388 Jun 03 11:58:33 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:34 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269.9ea74708-a3cb-4b3b-9926-608dd1f2c388" returned: 0 in 0.636s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Lock "cinder-quobyte-9ea74708-a3cb-4b3b-9926-608dd1f2c388" released by "_delete_snapshot" :: held 3.114s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.371s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.906s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:34 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1475251125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24fd2b41-185c-49c7-9f92-512b9f8b1a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7879b199b04b2fb3fb65f793b35cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:18Z,use_quota=True,user_id='9c02033335c0464f904f1e751004fa36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:58:34 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Creating volume 24fd2b41-185c-49c7-9f92-512b9f8b1a4b {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:58:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:34 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:34 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:34 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:58:34 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:58:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-24fd2b41-185c-49c7-9f92-512b9f8b1a4b 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:34 devstack sudo[96177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-24fd2b41-185c-49c7-9f92-512b9f8b1a4b 1073741824 Jun 03 11:58:34 devstack sudo[96177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:34 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2657ded-cfc4-4e41-882b-7807860c459a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65ce1df4-5f01-428d-8cec-02de7dadbc5f', 'volume_size': 1, 'source_volid': 'b3c654b6-2f6f-4822-895d-b14f71e03269', 'source_volstatus': 'available'}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:34 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93460c41-efe7-4b9f-beb4-208ba2b96747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:34 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Volume volume-65ce1df4-5f01-428d-8cec-02de7dadbc5f (65ce1df4-5f01-428d-8cec-02de7dadbc5f): created successfully Jun 03 11:58:34 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93460c41-efe7-4b9f-beb4-208ba2b96747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:34 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Flow 'volume_create_manager' (33e17bd6-e1f9-45cc-835d-3ba9e57c2ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:34 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-e0bf5f04-1f52-45a8-9bd8-a6190971dcc6 tempest-VolumesGetTest-1657425241 None] Created volume successfully. Jun 03 11:58:35 devstack sudo[96177]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-24fd2b41-185c-49c7-9f92-512b9f8b1a4b 1073741824" returned: 0 in 0.954s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-24fd2b41-185c-49c7-9f92-512b9f8b1a4b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:35 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-24fd2b41-185c-49c7-9f92-512b9f8b1a4b Jun 03 11:58:35 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:36 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-24fd2b41-185c-49c7-9f92-512b9f8b1a4b" returned: 0 in 0.663s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.808s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7047d2c1-e4b4-4c0f-a04d-f78e9939306a,created_at=2026-06-03T09:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-67166285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7047d2c1-e4b4-4c0f-a04d-f78e9939306a,host='devstack@QuobyteHD#QuobyteHD',id=7bcb25a2-036e-4c66-8088-a4c00949dbc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae6c25e368047faa22c9fa58e460312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:27Z,use_quota=True,user_id='774d84014a384fbb8a495aa09c3f2608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab622fde-6568-4919-b2cb-cbcd5c89f7db),volume_type_id=ab622fde-6568-4919-b2cb-cbcd5c89f7db)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Creating volume 7bcb25a2-036e-4c66-8088-a4c00949dbc8 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:58:36 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7bcb25a2-036e-4c66-8088-a4c00949dbc8 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73cb8ef-f47c-417e-a777-e3d819e99557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24fd2b41-185c-49c7-9f92-512b9f8b1a4b', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b9e851d-b715-4a49-ade4-0c468f11bf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:36 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7bcb25a2-036e-4c66-8088-a4c00949dbc8 1073741824 Jun 03 11:58:36 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:36 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Volume volume-24fd2b41-185c-49c7-9f92-512b9f8b1a4b (24fd2b41-185c-49c7-9f92-512b9f8b1a4b): created successfully Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b9e851d-b715-4a49-ade4-0c468f11bf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Flow 'volume_create_manager' (839986d3-bc88-4820-b27e-d8ff1decf604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:36 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-841188a2-a4d3-4849-98d8-2405a6800202 tempest-VolumesListAdminTestJSON-1375266145 None] Created volume successfully. Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Flow 'volume_create_manager' (b0cbd579-a210-4cc2-b699-0d3f3548da34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (514d1fc3-2e80-419e-9bfb-e421969413bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (514d1fc3-2e80-419e-9bfb-e421969413bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-670084540',display_name='tempest-VolumesGetTest-Volume-1583038187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfef256f739b47e0bcb9b08633c1941e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:36Z,use_quota=True,user_id='47d9db5178db42108b039a2b7d0dc2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f16e4bc-08a4-4a0c-809f-49fcfd03d7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f16e4bc-08a4-4a0c-809f-49fcfd03d7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f7bbc4-3187-4e1f-a5f3-78ee3051c24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f7bbc4-3187-4e1f-a5f3-78ee3051c24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9', 'volume_name': 'volume-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b53d5a-c3d9-4148-8dae-dc77cd76cd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b53d5a-c3d9-4148-8dae-dc77cd76cd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ea2a01a-2e9f-4fb8-84f9-b17502c0a2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:36 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Volume 0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9', 'volume_size': 1} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:36 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:58:36 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:37 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7bcb25a2-036e-4c66-8088-a4c00949dbc8 1073741824" returned: 0 in 0.976s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7bcb25a2-036e-4c66-8088-a4c00949dbc8 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:37 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7bcb25a2-036e-4c66-8088-a4c00949dbc8 Jun 03 11:58:37 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:37 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.905s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:37 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:58:38 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7bcb25a2-036e-4c66-8088-a4c00949dbc8" returned: 0 in 0.775s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.419s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-670084540',display_name='tempest-VolumesGetTest-Volume-1583038187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfef256f739b47e0bcb9b08633c1941e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:36Z,use_quota=True,user_id='47d9db5178db42108b039a2b7d0dc2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Creating volume 0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:58:38 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea56dbfe-741d-40f1-b0a0-9536610f39ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bcb25a2-036e-4c66-8088-a4c00949dbc8', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:38 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9 1073741824 Jun 03 11:58:38 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72fde716-b2d9-4033-83ea-bc0cb559b46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:38 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Volume volume-7bcb25a2-036e-4c66-8088-a4c00949dbc8 (7bcb25a2-036e-4c66-8088-a4c00949dbc8): created successfully Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72fde716-b2d9-4033-83ea-bc0cb559b46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Flow 'volume_create_manager' (ff46e946-27bb-4ff1-84c6-e5e92e1a6a4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:38 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-321ca457-775b-4340-a441-ef78c4c4c727 tempest-GroupsTest-1383947407 None] Created volume successfully. Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Flow 'volume_create_manager' (73807543-7c28-4adc-af86-8ff9ecacb90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10778b17-2219-4a2d-97f3-c2c66afb68fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10778b17-2219-4a2d-97f3-c2c66afb68fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f699bee-0571-4a08-bb1b-4eac59dfaefe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5904a260ff04abe9058f79629db8a55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:38Z,use_quota=True,user_id='c78c44cd003d4433ac1203c773c56791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e38d155d-72ba-4b61-b864-118bb719ad9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e38d155d-72ba-4b61-b864-118bb719ad9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94edc51a-0f79-43df-a411-2e9f4fd6ecd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94edc51a-0f79-43df-a411-2e9f4fd6ecd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f699bee-0571-4a08-bb1b-4eac59dfaefe', 'volume_name': 'volume-3f699bee-0571-4a08-bb1b-4eac59dfaefe', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045cbec2-9049-4848-aa95-98ba7a102732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045cbec2-9049-4848-aa95-98ba7a102732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73cd6ac-317c-42c0-9f28-fbd8c1d78849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:38 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Volume 3f699bee-0571-4a08-bb1b-4eac59dfaefe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f699bee-0571-4a08-bb1b-4eac59dfaefe', 'volume_size': 1} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-680b229a-6ce8-4f54-95e9-653b59c4a963 tempest-GroupsTest-1383947407 None] Acquiring lock "cinder-quobyte-7bcb25a2-036e-4c66-8088-a4c00949dbc8" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-680b229a-6ce8-4f54-95e9-653b59c4a963 tempest-GroupsTest-1383947407 None] Lock "cinder-quobyte-7bcb25a2-036e-4c66-8088-a4c00949dbc8" acquired by "delete_volume" :: waited 0.021s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f672e9e-6ee6-456c-a428-3076b73bf6cb]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-680b229a-6ce8-4f54-95e9-653b59c4a963 tempest-GroupsTest-1383947407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7bcb25a2-036e-4c66-8088-a4c00949dbc8 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:39 devstack sudo[96203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7bcb25a2-036e-4c66-8088-a4c00949dbc8 Jun 03 11:58:39 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:39 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9 1073741824" returned: 0 in 1.004s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:39 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9 Jun 03 11:58:39 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:39 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-680b229a-6ce8-4f54-95e9-653b59c4a963 tempest-GroupsTest-1383947407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7bcb25a2-036e-4c66-8088-a4c00949dbc8" returned: 0 in 0.900s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-680b229a-6ce8-4f54-95e9-653b59c4a963 tempest-GroupsTest-1383947407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7bcb25a2-036e-4c66-8088-a4c00949dbc8 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:39 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9" returned: 0 in 0.745s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:58:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:39 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7bcb25a2-036e-4c66-8088-a4c00949dbc8 Jun 03 11:58:39 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.487s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f699bee-0571-4a08-bb1b-4eac59dfaefe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5904a260ff04abe9058f79629db8a55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:38Z,use_quota=True,user_id='c78c44cd003d4433ac1203c773c56791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:58:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Creating volume 3f699bee-0571-4a08-bb1b-4eac59dfaefe {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:58:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:58:39 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:58:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3f699bee-0571-4a08-bb1b-4eac59dfaefe 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ea2a01a-2e9f-4fb8-84f9-b17502c0a2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05534de-ef94-4913-82df-9940776254e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:39 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3f699bee-0571-4a08-bb1b-4eac59dfaefe 1073741824 Jun 03 11:58:39 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:39 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Volume volume-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9 (0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9): created successfully Jun 03 11:58:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05534de-ef94-4913-82df-9940776254e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Flow 'volume_create_manager' (b0cbd579-a210-4cc2-b699-0d3f3548da34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:39 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-e0bd58c3-e5a6-41b7-be11-32fc941d8623 tempest-VolumesGetTest-1657425241 None] Created volume successfully. Jun 03 11:58:40 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-680b229a-6ce8-4f54-95e9-653b59c4a963 tempest-GroupsTest-1383947407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7bcb25a2-036e-4c66-8088-a4c00949dbc8" returned: 0 in 0.756s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:40 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-680b229a-6ce8-4f54-95e9-653b59c4a963 tempest-GroupsTest-1383947407 None] Lock "cinder-quobyte-7bcb25a2-036e-4c66-8088-a4c00949dbc8" released by "delete_volume" :: held 1.702s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:40 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-680b229a-6ce8-4f54-95e9-653b59c4a963 tempest-GroupsTest-1383947407 None] Created reservations ['e36a8f7b-abeb-41e9-a323-7d30da5f6a1d'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:58:40 devstack cinder-volume[86724]: WARNING cinder.quota [None req-680b229a-6ce8-4f54-95e9-653b59c4a963 tempest-GroupsTest-1383947407 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1025573978 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1025573978, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:58:40 devstack cinder-volume[86724]: WARNING cinder.quota [None req-680b229a-6ce8-4f54-95e9-653b59c4a963 tempest-GroupsTest-1383947407 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1025573978 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1025573978, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:58:40 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-680b229a-6ce8-4f54-95e9-653b59c4a963 tempest-GroupsTest-1383947407 None] Created reservations ['0e1fed3f-c587-4f40-b59c-b86e43092be6', '0b9d9dc1-2790-4e12-9a78-dbf4d91be159', '40daa500-fdf1-44f3-af06-411c4cd7ef3b', '14f9ec68-50cc-4558-80f8-bfc94088fa25'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:58:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-680b229a-6ce8-4f54-95e9-653b59c4a963 tempest-GroupsTest-1383947407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-680b229a-6ce8-4f54-95e9-653b59c4a963 tempest-GroupsTest-1383947407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-680b229a-6ce8-4f54-95e9-653b59c4a963 tempest-GroupsTest-1383947407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-680b229a-6ce8-4f54-95e9-653b59c4a963 tempest-GroupsTest-1383947407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-680b229a-6ce8-4f54-95e9-653b59c4a963 tempest-GroupsTest-1383947407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-680b229a-6ce8-4f54-95e9-653b59c4a963 tempest-GroupsTest-1383947407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:40 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3f699bee-0571-4a08-bb1b-4eac59dfaefe 1073741824" returned: 0 in 1.050s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:40 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:58:40 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3f699bee-0571-4a08-bb1b-4eac59dfaefe {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-cfc9bc8e-90a0-4251-9f83-12aba21d271a tempest-VolumesGetTest-1657425241 None] Acquiring lock "cinder-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:41 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3f699bee-0571-4a08-bb1b-4eac59dfaefe Jun 03 11:58:41 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-cfc9bc8e-90a0-4251-9f83-12aba21d271a tempest-VolumesGetTest-1657425241 None] Lock "cinder-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-cfc9bc8e-90a0-4251-9f83-12aba21d271a tempest-VolumesGetTest-1657425241 None] Acquiring lock "cinder-quobyte-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-cfc9bc8e-90a0-4251-9f83-12aba21d271a tempest-VolumesGetTest-1657425241 None] Lock "cinder-quobyte-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9" acquired by "delete_volume" :: waited 0.025s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:41 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f859787-879e-43d7-bf6c-e6609efac315]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cfc9bc8e-90a0-4251-9f83-12aba21d271a tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:41 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9 Jun 03 11:58:41 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:41 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-47ca69b8-da24-421d-b091-060c3eea1999 tempest-GroupsTest-1383947407 None] Created reservations ['53e6c7d7-66f6-4d2f-9b63-47b155b1c4b0'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:58:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-47ca69b8-da24-421d-b091-060c3eea1999 tempest-GroupsTest-1383947407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-47ca69b8-da24-421d-b091-060c3eea1999 tempest-GroupsTest-1383947407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:41 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-47ca69b8-da24-421d-b091-060c3eea1999 tempest-GroupsTest-1383947407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:41 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-47ca69b8-da24-421d-b091-060c3eea1999 tempest-GroupsTest-1383947407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-47ca69b8-da24-421d-b091-060c3eea1999 tempest-GroupsTest-1383947407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-47ca69b8-da24-421d-b091-060c3eea1999 tempest-GroupsTest-1383947407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:41 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:58:41 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:41 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-680b229a-6ce8-4f54-95e9-653b59c4a963 tempest-GroupsTest-1383947407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.715s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:41 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-680b229a-6ce8-4f54-95e9-653b59c4a963 tempest-GroupsTest-1383947407 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:58:41 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-680b229a-6ce8-4f54-95e9-653b59c4a963 tempest-GroupsTest-1383947407 None] Delete group completed successfully. Jun 03 11:58:41 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3f699bee-0571-4a08-bb1b-4eac59dfaefe" returned: 0 in 0.999s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:41 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:58:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.122s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:41 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73cd6ac-317c-42c0-9f28-fbd8c1d78849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f699bee-0571-4a08-bb1b-4eac59dfaefe', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:41 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922e41fd-4eec-47b0-a7a3-c02ca251991b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:42 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Volume volume-3f699bee-0571-4a08-bb1b-4eac59dfaefe (3f699bee-0571-4a08-bb1b-4eac59dfaefe): created successfully Jun 03 11:58:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922e41fd-4eec-47b0-a7a3-c02ca251991b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Flow 'volume_create_manager' (73807543-7c28-4adc-af86-8ff9ecacb90a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:42 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-3459bcd7-cb55-4f9e-9a7f-008b24e750c0 tempest-VolumesListAdminTestJSON-1419298353 None] Created volume successfully. Jun 03 11:58:42 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cfc9bc8e-90a0-4251-9f83-12aba21d271a tempest-VolumesGetTest-1657425241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9" returned: 0 in 1.005s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cfc9bc8e-90a0-4251-9f83-12aba21d271a tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:42 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9 Jun 03 11:58:42 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:42 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-47ca69b8-da24-421d-b091-060c3eea1999 tempest-GroupsTest-1383947407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.744s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:42 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-47ca69b8-da24-421d-b091-060c3eea1999 tempest-GroupsTest-1383947407 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:58:42 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-47ca69b8-da24-421d-b091-060c3eea1999 tempest-GroupsTest-1383947407 None] Delete group completed successfully. Jun 03 11:58:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5af779cb-d765-4675-b283-30cc694aefc2 tempest-VolumesListAdminTestJSON-1419298353 None] Acquiring lock "cinder-3f699bee-0571-4a08-bb1b-4eac59dfaefe-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5af779cb-d765-4675-b283-30cc694aefc2 tempest-VolumesListAdminTestJSON-1419298353 None] Lock "cinder-3f699bee-0571-4a08-bb1b-4eac59dfaefe-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5af779cb-d765-4675-b283-30cc694aefc2 tempest-VolumesListAdminTestJSON-1419298353 None] Acquiring lock "cinder-quobyte-3f699bee-0571-4a08-bb1b-4eac59dfaefe" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5af779cb-d765-4675-b283-30cc694aefc2 tempest-VolumesListAdminTestJSON-1419298353 None] Lock "cinder-quobyte-3f699bee-0571-4a08-bb1b-4eac59dfaefe" acquired by "delete_volume" :: waited 0.031s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:42 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8e229b-b774-46dc-ad03-fb8c14b881db]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5af779cb-d765-4675-b283-30cc694aefc2 tempest-VolumesListAdminTestJSON-1419298353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3f699bee-0571-4a08-bb1b-4eac59dfaefe {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-40ab5815-1832-4bea-8a5a-57fc3acdbcad tempest-VolumesListAdminTestJSON-1375266145 None] Acquiring lock "cinder-24fd2b41-185c-49c7-9f92-512b9f8b1a4b-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:43 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-40ab5815-1832-4bea-8a5a-57fc3acdbcad tempest-VolumesListAdminTestJSON-1375266145 None] Lock "cinder-24fd2b41-185c-49c7-9f92-512b9f8b1a4b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:43 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-40ab5815-1832-4bea-8a5a-57fc3acdbcad tempest-VolumesListAdminTestJSON-1375266145 None] Acquiring lock "cinder-quobyte-24fd2b41-185c-49c7-9f92-512b9f8b1a4b" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:43 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cfc9bc8e-90a0-4251-9f83-12aba21d271a tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9" returned: 0 in 0.921s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:43 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-40ab5815-1832-4bea-8a5a-57fc3acdbcad tempest-VolumesListAdminTestJSON-1375266145 None] Lock "cinder-quobyte-24fd2b41-185c-49c7-9f92-512b9f8b1a4b" acquired by "delete_volume" :: waited 0.051s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:43 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-0872e866-e2e8-474e-ab92-bb40b759e2ce tempest-GroupsTest-1383947407 None] Group tempest-GroupsTest-Group-1125286996: creating Jun 03 11:58:43 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-cfc9bc8e-90a0-4251-9f83-12aba21d271a tempest-VolumesGetTest-1657425241 None] Lock "cinder-quobyte-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9" released by "delete_volume" :: held 2.005s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:43 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3f699bee-0571-4a08-bb1b-4eac59dfaefe Jun 03 11:58:43 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:43 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a939e76-7b78-410d-9e9e-a73e7805af26]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-40ab5815-1832-4bea-8a5a-57fc3acdbcad tempest-VolumesListAdminTestJSON-1375266145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-24fd2b41-185c-49c7-9f92-512b9f8b1a4b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:43 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-0872e866-e2e8-474e-ab92-bb40b759e2ce tempest-GroupsTest-1383947407 None] Group tempest-GroupsTest-Group-1125286996: created successfully Jun 03 11:58:43 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-0872e866-e2e8-474e-ab92-bb40b759e2ce tempest-GroupsTest-1383947407 None] Create group completed successfully. Jun 03 11:58:43 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-cfc9bc8e-90a0-4251-9f83-12aba21d271a tempest-VolumesGetTest-1657425241 None] Created reservations ['c07b9f9b-dc65-4301-adb0-7efe1e088e0d', '85bd6773-463a-4e33-9914-7a796a5f6bfa', '48baa97d-b21e-49c3-892c-e85a307a6d25', '28f87c04-ce7e-42f2-a43d-aea6f5053cc8'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:58:43 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-24fd2b41-185c-49c7-9f92-512b9f8b1a4b Jun 03 11:58:43 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cfc9bc8e-90a0-4251-9f83-12aba21d271a tempest-VolumesGetTest-1657425241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cfc9bc8e-90a0-4251-9f83-12aba21d271a tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-cfc9bc8e-90a0-4251-9f83-12aba21d271a tempest-VolumesGetTest-1657425241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-cfc9bc8e-90a0-4251-9f83-12aba21d271a tempest-VolumesGetTest-1657425241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cfc9bc8e-90a0-4251-9f83-12aba21d271a tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cfc9bc8e-90a0-4251-9f83-12aba21d271a tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:43 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:58:43 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:43 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5af779cb-d765-4675-b283-30cc694aefc2 tempest-VolumesListAdminTestJSON-1419298353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3f699bee-0571-4a08-bb1b-4eac59dfaefe" returned: 0 in 0.999s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5af779cb-d765-4675-b283-30cc694aefc2 tempest-VolumesListAdminTestJSON-1419298353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3f699bee-0571-4a08-bb1b-4eac59dfaefe {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:43 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-40ab5815-1832-4bea-8a5a-57fc3acdbcad tempest-VolumesListAdminTestJSON-1375266145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-24fd2b41-185c-49c7-9f92-512b9f8b1a4b" returned: 0 in 0.819s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-40ab5815-1832-4bea-8a5a-57fc3acdbcad tempest-VolumesListAdminTestJSON-1375266145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-24fd2b41-185c-49c7-9f92-512b9f8b1a4b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:43 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3f699bee-0571-4a08-bb1b-4eac59dfaefe Jun 03 11:58:43 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:44 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-24fd2b41-185c-49c7-9f92-512b9f8b1a4b Jun 03 11:58:44 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:44 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cfc9bc8e-90a0-4251-9f83-12aba21d271a tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.702s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:44 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-cfc9bc8e-90a0-4251-9f83-12aba21d271a tempest-VolumesGetTest-1657425241 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:58:44 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-cfc9bc8e-90a0-4251-9f83-12aba21d271a tempest-VolumesGetTest-1657425241 None] Deleted volume successfully. Jun 03 11:58:44 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-cfc9bc8e-90a0-4251-9f83-12aba21d271a tempest-VolumesGetTest-1657425241 None] Lock "cinder-0ab905cf-1f0a-4ea3-bc8e-d3eb35476db9-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:44 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-831ffe0d-4c4a-491c-a823-ef4e61de30c0 tempest-VolumesGetTest-1657425241 None] Acquiring lock "cinder-65ce1df4-5f01-428d-8cec-02de7dadbc5f-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:44 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-831ffe0d-4c4a-491c-a823-ef4e61de30c0 tempest-VolumesGetTest-1657425241 None] Lock "cinder-65ce1df4-5f01-428d-8cec-02de7dadbc5f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:44 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-831ffe0d-4c4a-491c-a823-ef4e61de30c0 tempest-VolumesGetTest-1657425241 None] Acquiring lock "cinder-quobyte-65ce1df4-5f01-428d-8cec-02de7dadbc5f" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:44 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-831ffe0d-4c4a-491c-a823-ef4e61de30c0 tempest-VolumesGetTest-1657425241 None] Lock "cinder-quobyte-65ce1df4-5f01-428d-8cec-02de7dadbc5f" acquired by "delete_volume" :: waited 0.025s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:44 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[09da9b2f-e149-4b98-a8b8-c1e4c284bf75]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-831ffe0d-4c4a-491c-a823-ef4e61de30c0 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-65ce1df4-5f01-428d-8cec-02de7dadbc5f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:44 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:44 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-65ce1df4-5f01-428d-8cec-02de7dadbc5f Jun 03 11:58:44 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-40ab5815-1832-4bea-8a5a-57fc3acdbcad tempest-VolumesListAdminTestJSON-1375266145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-24fd2b41-185c-49c7-9f92-512b9f8b1a4b" returned: 0 in 0.950s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:44 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:58:44 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Flow 'volume_create_manager' (096ab621-1194-4871-8a0e-4804a33f2ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe6b9aef-7d83-4fcd-b342-1ac0151b6464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-40ab5815-1832-4bea-8a5a-57fc3acdbcad tempest-VolumesListAdminTestJSON-1375266145 None] Lock "cinder-quobyte-24fd2b41-185c-49c7-9f92-512b9f8b1a4b" released by "delete_volume" :: held 1.886s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5af779cb-d765-4675-b283-30cc694aefc2 tempest-VolumesListAdminTestJSON-1419298353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3f699bee-0571-4a08-bb1b-4eac59dfaefe" returned: 0 in 1.071s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe6b9aef-7d83-4fcd-b342-1ac0151b6464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1009383507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e7908a6d-1446-470f-8358-ccc9231e105d,host='devstack@QuobyteHD#QuobyteHD',id=492f7a62-299d-49f3-9648-d0c51d999efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae6c25e368047faa22c9fa58e460312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:45Z,use_quota=True,user_id='774d84014a384fbb8a495aa09c3f2608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(643427dc-db5b-4e84-98d9-5ecc4f960490),volume_type_id=643427dc-db5b-4e84-98d9-5ecc4f960490)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d966625d-b2e2-44b2-a61c-b41b01d676d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d966625d-b2e2-44b2-a61c-b41b01d676d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd3173a-bafc-4b79-8a99-d5e46628f6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd3173a-bafc-4b79-8a99-d5e46628f6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '492f7a62-299d-49f3-9648-d0c51d999efa', 'volume_name': 'volume-492f7a62-299d-49f3-9648-d0c51d999efa', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65cab96-d98a-49b6-846d-99e886900e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65cab96-d98a-49b6-846d-99e886900e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71396cf-b8cb-4cd4-af08-27b2291f5f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:45 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Volume 492f7a62-299d-49f3-9648-d0c51d999efa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-492f7a62-299d-49f3-9648-d0c51d999efa', 'volume_size': 1} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e7908a6d-1446-470f-8358-ccc9231e105d,created_at=2026-06-03T09:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1009383507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e7908a6d-1446-470f-8358-ccc9231e105d,host='devstack@QuobyteHD#QuobyteHD',id=492f7a62-299d-49f3-9648-d0c51d999efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae6c25e368047faa22c9fa58e460312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:45Z,use_quota=True,user_id='774d84014a384fbb8a495aa09c3f2608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(643427dc-db5b-4e84-98d9-5ecc4f960490),volume_type_id=643427dc-db5b-4e84-98d9-5ecc4f960490)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Creating volume 492f7a62-299d-49f3-9648-d0c51d999efa {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:58:45 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-492f7a62-299d-49f3-9648-d0c51d999efa 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5af779cb-d765-4675-b283-30cc694aefc2 tempest-VolumesListAdminTestJSON-1419298353 None] Lock "cinder-quobyte-3f699bee-0571-4a08-bb1b-4eac59dfaefe" released by "delete_volume" :: held 2.190s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:45 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-492f7a62-299d-49f3-9648-d0c51d999efa 1073741824 Jun 03 11:58:45 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-40ab5815-1832-4bea-8a5a-57fc3acdbcad tempest-VolumesListAdminTestJSON-1375266145 None] Created reservations ['e5545b52-3793-44f2-8978-6e48dfb54ad1', '8b2feadf-bbc5-4f1d-a7ee-d6ab35ac3c00', '28aa232d-3b55-4fc7-967e-e8a25c01017c', '718382cc-b642-414a-8e51-e8d7ef9cab1b'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-5af779cb-d765-4675-b283-30cc694aefc2 tempest-VolumesListAdminTestJSON-1419298353 None] Created reservations ['4c8442e4-8e97-4a8e-b0aa-2aa4a022627e', 'ba4e73eb-c013-4485-af41-ef5496f67f1c', 'b76c783b-e74c-40bc-a755-aa2a9303d1c5', 'd9e18e72-b51f-450f-bd88-31a1f8c3fcf1'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-40ab5815-1832-4bea-8a5a-57fc3acdbcad tempest-VolumesListAdminTestJSON-1375266145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-40ab5815-1832-4bea-8a5a-57fc3acdbcad tempest-VolumesListAdminTestJSON-1375266145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-40ab5815-1832-4bea-8a5a-57fc3acdbcad tempest-VolumesListAdminTestJSON-1375266145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-40ab5815-1832-4bea-8a5a-57fc3acdbcad tempest-VolumesListAdminTestJSON-1375266145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-40ab5815-1832-4bea-8a5a-57fc3acdbcad tempest-VolumesListAdminTestJSON-1375266145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-40ab5815-1832-4bea-8a5a-57fc3acdbcad tempest-VolumesListAdminTestJSON-1375266145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5af779cb-d765-4675-b283-30cc694aefc2 tempest-VolumesListAdminTestJSON-1419298353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5af779cb-d765-4675-b283-30cc694aefc2 tempest-VolumesListAdminTestJSON-1419298353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5af779cb-d765-4675-b283-30cc694aefc2 tempest-VolumesListAdminTestJSON-1419298353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5af779cb-d765-4675-b283-30cc694aefc2 tempest-VolumesListAdminTestJSON-1419298353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5af779cb-d765-4675-b283-30cc694aefc2 tempest-VolumesListAdminTestJSON-1419298353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5af779cb-d765-4675-b283-30cc694aefc2 tempest-VolumesListAdminTestJSON-1419298353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:45 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:58:45 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:45 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:58:45 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-98c4a8ad-ac49-4365-9e09-cfa433710807 tempest-VolumesListAdminTestJSON-1375266145 None] Acquiring lock "cinder-cac43a29-9c79-43af-963d-5a5a2c53dae3-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-98c4a8ad-ac49-4365-9e09-cfa433710807 tempest-VolumesListAdminTestJSON-1375266145 None] Lock "cinder-cac43a29-9c79-43af-963d-5a5a2c53dae3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-98c4a8ad-ac49-4365-9e09-cfa433710807 tempest-VolumesListAdminTestJSON-1375266145 None] Acquiring lock "cinder-quobyte-cac43a29-9c79-43af-963d-5a5a2c53dae3" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-98c4a8ad-ac49-4365-9e09-cfa433710807 tempest-VolumesListAdminTestJSON-1375266145 None] Lock "cinder-quobyte-cac43a29-9c79-43af-963d-5a5a2c53dae3" acquired by "delete_volume" :: waited 0.050s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d192c0-9e37-4264-9de6-08fe617672f7]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98c4a8ad-ac49-4365-9e09-cfa433710807 tempest-VolumesListAdminTestJSON-1375266145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cac43a29-9c79-43af-963d-5a5a2c53dae3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:45 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cac43a29-9c79-43af-963d-5a5a2c53dae3 Jun 03 11:58:45 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:46 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-831ffe0d-4c4a-491c-a823-ef4e61de30c0 tempest-VolumesGetTest-1657425241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-65ce1df4-5f01-428d-8cec-02de7dadbc5f" returned: 0 in 1.479s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-831ffe0d-4c4a-491c-a823-ef4e61de30c0 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-65ce1df4-5f01-428d-8cec-02de7dadbc5f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:46 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-65ce1df4-5f01-428d-8cec-02de7dadbc5f Jun 03 11:58:46 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:46 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-40ab5815-1832-4bea-8a5a-57fc3acdbcad tempest-VolumesListAdminTestJSON-1375266145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.129s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:46 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-40ab5815-1832-4bea-8a5a-57fc3acdbcad tempest-VolumesListAdminTestJSON-1375266145 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:58:46 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-40ab5815-1832-4bea-8a5a-57fc3acdbcad tempest-VolumesListAdminTestJSON-1375266145 None] Deleted volume successfully. Jun 03 11:58:46 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-40ab5815-1832-4bea-8a5a-57fc3acdbcad tempest-VolumesListAdminTestJSON-1375266145 None] Lock "cinder-24fd2b41-185c-49c7-9f92-512b9f8b1a4b-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:46 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-492f7a62-299d-49f3-9648-d0c51d999efa 1073741824" returned: 0 in 1.511s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:46 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5af779cb-d765-4675-b283-30cc694aefc2 tempest-VolumesListAdminTestJSON-1419298353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.272s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:46 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5af779cb-d765-4675-b283-30cc694aefc2 tempest-VolumesListAdminTestJSON-1419298353 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:58:46 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-5af779cb-d765-4675-b283-30cc694aefc2 tempest-VolumesListAdminTestJSON-1419298353 None] Deleted volume successfully. Jun 03 11:58:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-492f7a62-299d-49f3-9648-d0c51d999efa {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:46 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5af779cb-d765-4675-b283-30cc694aefc2 tempest-VolumesListAdminTestJSON-1419298353 None] Lock "cinder-3f699bee-0571-4a08-bb1b-4eac59dfaefe-delete_volume" released by "delete_volume" :: held 3.930s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:46 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-492f7a62-299d-49f3-9648-d0c51d999efa Jun 03 11:58:46 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:47 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98c4a8ad-ac49-4365-9e09-cfa433710807 tempest-VolumesListAdminTestJSON-1375266145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cac43a29-9c79-43af-963d-5a5a2c53dae3" returned: 0 in 1.348s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98c4a8ad-ac49-4365-9e09-cfa433710807 tempest-VolumesListAdminTestJSON-1375266145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cac43a29-9c79-43af-963d-5a5a2c53dae3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:47 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cac43a29-9c79-43af-963d-5a5a2c53dae3 Jun 03 11:58:47 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:47 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-831ffe0d-4c4a-491c-a823-ef4e61de30c0 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-65ce1df4-5f01-428d-8cec-02de7dadbc5f" returned: 0 in 0.940s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-831ffe0d-4c4a-491c-a823-ef4e61de30c0 tempest-VolumesGetTest-1657425241 None] Lock "cinder-quobyte-65ce1df4-5f01-428d-8cec-02de7dadbc5f" released by "delete_volume" :: held 2.488s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-831ffe0d-4c4a-491c-a823-ef4e61de30c0 tempest-VolumesGetTest-1657425241 None] Created reservations ['1bebfe82-f254-48eb-8b45-09eef0bba518', '5a547d48-c954-4470-a769-b42ea0dbb6ba', '8a170f4c-20db-4f50-bcdf-64d370ce9040', '694dfa27-63bf-4b34-9700-790212e71e36'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-831ffe0d-4c4a-491c-a823-ef4e61de30c0 tempest-VolumesGetTest-1657425241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-831ffe0d-4c4a-491c-a823-ef4e61de30c0 tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-831ffe0d-4c4a-491c-a823-ef4e61de30c0 tempest-VolumesGetTest-1657425241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-831ffe0d-4c4a-491c-a823-ef4e61de30c0 tempest-VolumesGetTest-1657425241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-831ffe0d-4c4a-491c-a823-ef4e61de30c0 tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-831ffe0d-4c4a-491c-a823-ef4e61de30c0 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:47 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:58:47 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:47 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-492f7a62-299d-49f3-9648-d0c51d999efa" returned: 0 in 0.990s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] <== create_volume: return (2580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.582s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71396cf-b8cb-4cd4-af08-27b2291f5f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-492f7a62-299d-49f3-9648-d0c51d999efa', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df3681c-7a13-4a2e-9ec4-760f698ef216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:47 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Volume volume-492f7a62-299d-49f3-9648-d0c51d999efa (492f7a62-299d-49f3-9648-d0c51d999efa): created successfully Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df3681c-7a13-4a2e-9ec4-760f698ef216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Flow 'volume_create_manager' (096ab621-1194-4871-8a0e-4804a33f2ff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:47 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-53fbb65f-836d-4e40-826a-e821fff2e051 tempest-GroupsTest-1383947407 None] Created volume successfully. Jun 03 11:58:47 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98c4a8ad-ac49-4365-9e09-cfa433710807 tempest-VolumesListAdminTestJSON-1375266145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cac43a29-9c79-43af-963d-5a5a2c53dae3" returned: 0 in 0.700s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-98c4a8ad-ac49-4365-9e09-cfa433710807 tempest-VolumesListAdminTestJSON-1375266145 None] Lock "cinder-quobyte-cac43a29-9c79-43af-963d-5a5a2c53dae3" released by "delete_volume" :: held 2.131s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-98c4a8ad-ac49-4365-9e09-cfa433710807 tempest-VolumesListAdminTestJSON-1375266145 None] Created reservations ['49f900ba-d13c-46be-a8c2-c9982ec07a19', '027351b1-f6a5-4b31-b39f-f9156369af65', '61960a1b-63af-43a2-89b7-e474db852df0', '6e038fe1-87eb-4c1f-8ce6-587eb27faca1'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-98c4a8ad-ac49-4365-9e09-cfa433710807 tempest-VolumesListAdminTestJSON-1375266145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-98c4a8ad-ac49-4365-9e09-cfa433710807 tempest-VolumesListAdminTestJSON-1375266145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-98c4a8ad-ac49-4365-9e09-cfa433710807 tempest-VolumesListAdminTestJSON-1375266145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-98c4a8ad-ac49-4365-9e09-cfa433710807 tempest-VolumesListAdminTestJSON-1375266145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-98c4a8ad-ac49-4365-9e09-cfa433710807 tempest-VolumesListAdminTestJSON-1375266145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98c4a8ad-ac49-4365-9e09-cfa433710807 tempest-VolumesListAdminTestJSON-1375266145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:48 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:58:48 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:48 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-831ffe0d-4c4a-491c-a823-ef4e61de30c0 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.698s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:48 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-831ffe0d-4c4a-491c-a823-ef4e61de30c0 tempest-VolumesGetTest-1657425241 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:58:48 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-831ffe0d-4c4a-491c-a823-ef4e61de30c0 tempest-VolumesGetTest-1657425241 None] Deleted volume successfully. Jun 03 11:58:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-831ffe0d-4c4a-491c-a823-ef4e61de30c0 tempest-VolumesGetTest-1657425241 None] Lock "cinder-65ce1df4-5f01-428d-8cec-02de7dadbc5f-delete_volume" released by "delete_volume" :: held 3.475s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-39f9b601-88e2-436c-8312-1dc0cd08e5fd tempest-VolumesGetTest-1657425241 None] Acquiring lock "cinder-b3c654b6-2f6f-4822-895d-b14f71e03269-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-39f9b601-88e2-436c-8312-1dc0cd08e5fd tempest-VolumesGetTest-1657425241 None] Lock "cinder-b3c654b6-2f6f-4822-895d-b14f71e03269-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-39f9b601-88e2-436c-8312-1dc0cd08e5fd tempest-VolumesGetTest-1657425241 None] Acquiring lock "cinder-quobyte-b3c654b6-2f6f-4822-895d-b14f71e03269" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-39f9b601-88e2-436c-8312-1dc0cd08e5fd tempest-VolumesGetTest-1657425241 None] Lock "cinder-quobyte-b3c654b6-2f6f-4822-895d-b14f71e03269" acquired by "delete_volume" :: waited 0.028s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:48 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed3a9d4-3564-4af8-8ab1-3318d0091f1a]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-39f9b601-88e2-436c-8312-1dc0cd08e5fd tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:48 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269 Jun 03 11:58:48 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:48 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98c4a8ad-ac49-4365-9e09-cfa433710807 tempest-VolumesListAdminTestJSON-1375266145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.717s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:48 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-98c4a8ad-ac49-4365-9e09-cfa433710807 tempest-VolumesListAdminTestJSON-1375266145 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:58:48 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-98c4a8ad-ac49-4365-9e09-cfa433710807 tempest-VolumesListAdminTestJSON-1375266145 None] Deleted volume successfully. Jun 03 11:58:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-98c4a8ad-ac49-4365-9e09-cfa433710807 tempest-VolumesListAdminTestJSON-1375266145 None] Lock "cinder-cac43a29-9c79-43af-963d-5a5a2c53dae3-delete_volume" released by "delete_volume" :: held 3.183s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:48 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:58:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Flow 'volume_create_manager' (9a763077-53f6-44db-8976-e0087e5a8810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2425243-5bde-47cd-bda7-c029f194aa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2425243-5bde-47cd-bda7-c029f194aa1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2094963125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e7908a6d-1446-470f-8358-ccc9231e105d,host='devstack@QuobyteHD#QuobyteHD',id=690b1a3b-60c5-49c6-96a6-ea2576f97e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae6c25e368047faa22c9fa58e460312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:49Z,use_quota=True,user_id='774d84014a384fbb8a495aa09c3f2608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(643427dc-db5b-4e84-98d9-5ecc4f960490),volume_type_id=643427dc-db5b-4e84-98d9-5ecc4f960490)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (863c9642-580b-42a3-a682-dae6fa9735bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (863c9642-580b-42a3-a682-dae6fa9735bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ee696b-53a1-46e6-bf56-faabeb506f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ee696b-53a1-46e6-bf56-faabeb506f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '690b1a3b-60c5-49c6-96a6-ea2576f97e31', 'volume_name': 'volume-690b1a3b-60c5-49c6-96a6-ea2576f97e31', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4031da35-55c0-4e3c-9b99-11067df521c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4031da35-55c0-4e3c-9b99-11067df521c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a725512-3a65-401f-ac73-2a8bf645783d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:49 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Volume 690b1a3b-60c5-49c6-96a6-ea2576f97e31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-690b1a3b-60c5-49c6-96a6-ea2576f97e31', 'volume_size': 1} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e7908a6d-1446-470f-8358-ccc9231e105d,created_at=2026-06-03T09:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2094963125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e7908a6d-1446-470f-8358-ccc9231e105d,host='devstack@QuobyteHD#QuobyteHD',id=690b1a3b-60c5-49c6-96a6-ea2576f97e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae6c25e368047faa22c9fa58e460312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:49Z,use_quota=True,user_id='774d84014a384fbb8a495aa09c3f2608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(643427dc-db5b-4e84-98d9-5ecc4f960490),volume_type_id=643427dc-db5b-4e84-98d9-5ecc4f960490)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Creating volume 690b1a3b-60c5-49c6-96a6-ea2576f97e31 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:58:49 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-690b1a3b-60c5-49c6-96a6-ea2576f97e31 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:49 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-690b1a3b-60c5-49c6-96a6-ea2576f97e31 1073741824 Jun 03 11:58:49 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d0a7d652-8b10-4a66-a3a0-e07ebf7bd61f tempest-VolumesListAdminTestJSON-1375266145 None] Acquiring lock "cinder-811e92c1-7d65-42e5-b882-36d1e5b41457-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d0a7d652-8b10-4a66-a3a0-e07ebf7bd61f tempest-VolumesListAdminTestJSON-1375266145 None] Lock "cinder-811e92c1-7d65-42e5-b882-36d1e5b41457-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d0a7d652-8b10-4a66-a3a0-e07ebf7bd61f tempest-VolumesListAdminTestJSON-1375266145 None] Acquiring lock "cinder-quobyte-811e92c1-7d65-42e5-b882-36d1e5b41457" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d0a7d652-8b10-4a66-a3a0-e07ebf7bd61f tempest-VolumesListAdminTestJSON-1375266145 None] Lock "cinder-quobyte-811e92c1-7d65-42e5-b882-36d1e5b41457" acquired by "delete_volume" :: waited 0.028s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2415306-10f9-4b8b-a4c8-0e09f173c44b]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d0a7d652-8b10-4a66-a3a0-e07ebf7bd61f tempest-VolumesListAdminTestJSON-1375266145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-811e92c1-7d65-42e5-b882-36d1e5b41457 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:49 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-39f9b601-88e2-436c-8312-1dc0cd08e5fd tempest-VolumesGetTest-1657425241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269" returned: 0 in 1.084s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-39f9b601-88e2-436c-8312-1dc0cd08e5fd tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:49 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269 Jun 03 11:58:49 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:49 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-811e92c1-7d65-42e5-b882-36d1e5b41457 Jun 03 11:58:49 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:50 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-690b1a3b-60c5-49c6-96a6-ea2576f97e31 1073741824" returned: 0 in 1.141s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:50 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-690b1a3b-60c5-49c6-96a6-ea2576f97e31 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-39f9b601-88e2-436c-8312-1dc0cd08e5fd tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b3c654b6-2f6f-4822-895d-b14f71e03269" returned: 0 in 0.864s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:50 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-690b1a3b-60c5-49c6-96a6-ea2576f97e31 Jun 03 11:58:50 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-39f9b601-88e2-436c-8312-1dc0cd08e5fd tempest-VolumesGetTest-1657425241 None] Lock "cinder-quobyte-b3c654b6-2f6f-4822-895d-b14f71e03269" released by "delete_volume" :: held 2.069s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d0a7d652-8b10-4a66-a3a0-e07ebf7bd61f tempest-VolumesListAdminTestJSON-1375266145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-811e92c1-7d65-42e5-b882-36d1e5b41457" returned: 0 in 0.994s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d0a7d652-8b10-4a66-a3a0-e07ebf7bd61f tempest-VolumesListAdminTestJSON-1375266145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-811e92c1-7d65-42e5-b882-36d1e5b41457 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:50 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:50 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-811e92c1-7d65-42e5-b882-36d1e5b41457 Jun 03 11:58:50 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:50 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-39f9b601-88e2-436c-8312-1dc0cd08e5fd tempest-VolumesGetTest-1657425241 None] Created reservations ['94a1bd0d-f9cd-45b0-98a7-312b2a1a2458', '19560636-702a-40b6-96c2-51a580d7db3c', '4307d156-6244-42f6-a38d-87f39a3156f2', '106310f7-30ea-4b56-beea-fd7f5086cbb7'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:58:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-39f9b601-88e2-436c-8312-1dc0cd08e5fd tempest-VolumesGetTest-1657425241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-39f9b601-88e2-436c-8312-1dc0cd08e5fd tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:50 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-39f9b601-88e2-436c-8312-1dc0cd08e5fd tempest-VolumesGetTest-1657425241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:50 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-39f9b601-88e2-436c-8312-1dc0cd08e5fd tempest-VolumesGetTest-1657425241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-39f9b601-88e2-436c-8312-1dc0cd08e5fd tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-39f9b601-88e2-436c-8312-1dc0cd08e5fd tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:50 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:58:50 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:51 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-690b1a3b-60c5-49c6-96a6-ea2576f97e31" returned: 0 in 0.849s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:58:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a725512-3a65-401f-ac73-2a8bf645783d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-690b1a3b-60c5-49c6-96a6-ea2576f97e31', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543be0fb-47f6-4077-b6da-1f4cc2dea5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:51 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Volume volume-690b1a3b-60c5-49c6-96a6-ea2576f97e31 (690b1a3b-60c5-49c6-96a6-ea2576f97e31): created successfully Jun 03 11:58:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543be0fb-47f6-4077-b6da-1f4cc2dea5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:51 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Flow 'volume_create_manager' (9a763077-53f6-44db-8976-e0087e5a8810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d0a7d652-8b10-4a66-a3a0-e07ebf7bd61f tempest-VolumesListAdminTestJSON-1375266145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-811e92c1-7d65-42e5-b882-36d1e5b41457" returned: 0 in 0.826s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:51 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d0a7d652-8b10-4a66-a3a0-e07ebf7bd61f tempest-VolumesListAdminTestJSON-1375266145 None] Lock "cinder-quobyte-811e92c1-7d65-42e5-b882-36d1e5b41457" released by "delete_volume" :: held 1.895s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:51 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a04fd391-5c43-48de-a14b-3fc2313f670c tempest-GroupsTest-1383947407 None] Created volume successfully. Jun 03 11:58:51 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-d0a7d652-8b10-4a66-a3a0-e07ebf7bd61f tempest-VolumesListAdminTestJSON-1375266145 None] Created reservations ['7023c599-fd70-486a-8c4d-ba9d0307c650', 'e29ee179-f1d2-4d1d-87c7-99f5b78b0858', '24996dc5-8d77-46ad-95dd-40210c6c38f0', 'a1c2d32d-30a2-4a51-ad34-740a44719ac2'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:58:51 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-39f9b601-88e2-436c-8312-1dc0cd08e5fd tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.804s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:51 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-39f9b601-88e2-436c-8312-1dc0cd08e5fd tempest-VolumesGetTest-1657425241 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:58:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d0a7d652-8b10-4a66-a3a0-e07ebf7bd61f tempest-VolumesListAdminTestJSON-1375266145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d0a7d652-8b10-4a66-a3a0-e07ebf7bd61f tempest-VolumesListAdminTestJSON-1375266145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d0a7d652-8b10-4a66-a3a0-e07ebf7bd61f tempest-VolumesListAdminTestJSON-1375266145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d0a7d652-8b10-4a66-a3a0-e07ebf7bd61f tempest-VolumesListAdminTestJSON-1375266145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d0a7d652-8b10-4a66-a3a0-e07ebf7bd61f tempest-VolumesListAdminTestJSON-1375266145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d0a7d652-8b10-4a66-a3a0-e07ebf7bd61f tempest-VolumesListAdminTestJSON-1375266145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:51 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-39f9b601-88e2-436c-8312-1dc0cd08e5fd tempest-VolumesGetTest-1657425241 None] Deleted volume successfully. Jun 03 11:58:51 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:58:51 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:51 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-39f9b601-88e2-436c-8312-1dc0cd08e5fd tempest-VolumesGetTest-1657425241 None] Lock "cinder-b3c654b6-2f6f-4822-895d-b14f71e03269-delete_volume" released by "delete_volume" :: held 3.275s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:51 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d9b73064-c073-49e3-bec5-4622a575de6d tempest-GroupsTest-1383947407 None] Update group completed successfully. Jun 03 11:58:52 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d0a7d652-8b10-4a66-a3a0-e07ebf7bd61f tempest-VolumesListAdminTestJSON-1375266145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.150s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:52 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-d0a7d652-8b10-4a66-a3a0-e07ebf7bd61f tempest-VolumesListAdminTestJSON-1375266145 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:58:52 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d0a7d652-8b10-4a66-a3a0-e07ebf7bd61f tempest-VolumesListAdminTestJSON-1375266145 None] Deleted volume successfully. Jun 03 11:58:52 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:58:52 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Flow 'volume_create_manager' (cb39fd33-dae3-4992-8880-e3671869a660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:58:52 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70047cd2-77f3-43e7-8617-104e1756a9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d0a7d652-8b10-4a66-a3a0-e07ebf7bd61f tempest-VolumesListAdminTestJSON-1375266145 None] Lock "cinder-811e92c1-7d65-42e5-b882-36d1e5b41457-delete_volume" released by "delete_volume" :: held 3.388s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:52 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70047cd2-77f3-43e7-8617-104e1756a9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2085913415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bf12c2-4e24-4a5f-aec8-5af8d5281e32,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bfef256f739b47e0bcb9b08633c1941e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:52Z,use_quota=True,user_id='47d9db5178db42108b039a2b7d0dc2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:52 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29caec00-e984-4ec2-8448-1a67d8fb07b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:52 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29caec00-e984-4ec2-8448-1a67d8fb07b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:52 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20299dc8-7cab-45d5-977d-c70953f10823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:52 devstack cinder-volume[86724]: DEBUG cinder.image.glance [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Creating Keystone auth plugin from conf {{(pid=86724) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 03 11:58:52 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-35338990-7591-4c32-bac3-b003e351098d tempest-GroupsTest-1383947407 None] Update group completed successfully. Jun 03 11:58:53 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20299dc8-7cab-45d5-977d-c70953f10823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '82bf12c2-4e24-4a5f-aec8-5af8d5281e32', 'volume_name': 'volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32', 'volume_size': 1, 'image_id': '0249897e-120c-42bb-b1a8-f517317c1907', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e70522cb7d6245e7970314b42bb711e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0249897e-120c-42bb-b1a8-f517317c1907', 'created_at': datetime.datetime(2026, 6, 3, 9, 43, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 9, 43, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0249897e-120c-42bb-b1a8-f517317c1907/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:53 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4473724b-a136-474f-9f0f-cd0f690e7370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:53 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4473724b-a136-474f-9f0f-cd0f690e7370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:58:53 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3792120-ba41-470a-9b5f-e23d883bc954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:58:53 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Volume 82bf12c2-4e24-4a5f-aec8-5af8d5281e32: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32', 'volume_size': 1, 'image_id': '0249897e-120c-42bb-b1a8-f517317c1907', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e70522cb7d6245e7970314b42bb711e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0249897e-120c-42bb-b1a8-f517317c1907', 'created_at': datetime.datetime(2026, 6, 3, 9, 43, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 9, 43, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0249897e-120c-42bb-b1a8-f517317c1907/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 03 11:58:53 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Trying to clone 82bf12c2-4e24-4a5f-aec8-5af8d5281e32 from image 0249897e-120c-42bb-b1a8-f517317c1907 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}]). {{(pid=86724) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 03 11:58:53 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_874u353adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 03 11:58:53 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Image download 20.69 MB at 20.69 MB/s Jun 03 11:58:53 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1153f83-3ae7-4e41-b054-210eb6492247]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_874u353adevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:53 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_874u353adevstack@QuobyteHD Jun 03 11:58:53 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Acquiring lock "cinder-quobyte-492f7a62-299d-49f3-9648-d0c51d999efa" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Lock "cinder-quobyte-492f7a62-299d-49f3-9648-d0c51d999efa" acquired by "delete_volume" :: waited 0.027s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:54 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_874u353adevstack@QuobyteHD" returned: 0 in 0.875s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:54 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Temporary image 0249897e-120c-42bb-b1a8-f517317c1907 is fetched for user 47d9db5178db42108b039a2b7d0dc2b9. {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 03 11:58:54 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[40de12f9-7b3e-4b34-8030-ddbdbb0e1fc7]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-492f7a62-299d-49f3-9648-d0c51d999efa {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:54 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b7fd04-294c-4888-aa9f-9261730c17ac]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_874u353adevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:54 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-492f7a62-299d-49f3-9648-d0c51d999efa Jun 03 11:58:54 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:54 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_874u353adevstack@QuobyteHD Jun 03 11:58:54 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:55 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-492f7a62-299d-49f3-9648-d0c51d999efa" returned: 0 in 0.923s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-492f7a62-299d-49f3-9648-d0c51d999efa {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:55 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-492f7a62-299d-49f3-9648-d0c51d999efa Jun 03 11:58:55 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:55 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_874u353adevstack@QuobyteHD" returned: 0 in 0.905s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:55 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2085913415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bf12c2-4e24-4a5f-aec8-5af8d5281e32,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bfef256f739b47e0bcb9b08633c1941e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:58:52Z,use_quota=True,user_id='47d9db5178db42108b039a2b7d0dc2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:58:55 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Creating volume 82bf12c2-4e24-4a5f-aec8-5af8d5281e32 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:58:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:55 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:55 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:55 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:58:55 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:58:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:55 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 1073741824 Jun 03 11:58:55 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:56 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-492f7a62-299d-49f3-9648-d0c51d999efa" returned: 0 in 0.845s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Lock "cinder-quobyte-492f7a62-299d-49f3-9648-d0c51d999efa" released by "delete_volume" :: held 1.860s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Acquiring lock "cinder-quobyte-690b1a3b-60c5-49c6-96a6-ea2576f97e31" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:58:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Lock "cinder-quobyte-690b1a3b-60c5-49c6-96a6-ea2576f97e31" acquired by "delete_volume" :: waited 0.025s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:58:56 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[336269cf-baa9-4ea5-8ccc-0549ad66a226]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-690b1a3b-60c5-49c6-96a6-ea2576f97e31 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:56 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-690b1a3b-60c5-49c6-96a6-ea2576f97e31 Jun 03 11:58:56 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:56 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 1073741824" returned: 0 in 1.146s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:56 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 Jun 03 11:58:56 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:57 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-690b1a3b-60c5-49c6-96a6-ea2576f97e31" returned: 0 in 0.955s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-690b1a3b-60c5-49c6-96a6-ea2576f97e31 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:57 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-690b1a3b-60c5-49c6-96a6-ea2576f97e31 Jun 03 11:58:57 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:57 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32" returned: 0 in 0.700s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:57 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:58:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:57 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Attempting download of 0249897e-120c-42bb-b1a8-f517317c1907 ((None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}])) to volume 82bf12c2-4e24-4a5f-aec8-5af8d5281e32. {{(pid=86724) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 03 11:58:57 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[70529921-d4bd-4d2b-9d03-764563585665]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_pw0u5azz {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:57 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_pw0u5azz Jun 03 11:58:57 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:58 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-690b1a3b-60c5-49c6-96a6-ea2576f97e31" returned: 0 in 0.789s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:58 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Lock "cinder-quobyte-690b1a3b-60c5-49c6-96a6-ea2576f97e31" released by "delete_volume" :: held 1.795s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:58:58 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Created reservations ['4ef74572-ed9c-4989-abdd-71d6eb8bd2da'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:58:58 devstack cinder-volume[86724]: WARNING cinder.quota [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-606840263 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-606840263, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:58:58 devstack cinder-volume[86724]: WARNING cinder.quota [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-606840263 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-606840263, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:58:58 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Created reservations ['b45dd02d-b927-4877-9c0e-d6624885a2b5', 'fe02d46b-094c-444c-8421-05c3ab9caaa3', '3459a753-863a-401b-a40e-7f83113d04c6', 'd3b2d967-b40c-4413-883c-8332523ef030'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:58:58 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_pw0u5azz" returned: 0 in 0.835s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_pw0u5azz {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:58 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Created reservations ['11cce7b6-4008-4856-a7d9-d7ff8b335e15', '71e23131-2728-4b26-9e0a-dba9a1e53bd1', 'd4ddf13c-a738-4524-8354-3b8850d5a4e7', '6e5fb9ca-dde2-414c-ad74-502b7a9fd61d'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:58:58 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_pw0u5azz Jun 03 11:58:58 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:58:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:58:58 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:58:58 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:58:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:58:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:58 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:58:58 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:59 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_pw0u5azz" returned: 1 in 0.928s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_pw0u5azz' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 11:58:59 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6f0639-d8b6-4356-9eed-9a9b086353bd]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:58:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_874u353adevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:58:59 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_874u353adevstack@QuobyteHD Jun 03 11:58:59 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:58:59 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Jun 03 11:58:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.912s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:58:59 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:58:59 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-dcb0abfd-70c3-40c4-92b3-dd8dec48f95a tempest-GroupsTest-1383947407 None] Delete group completed successfully. Jun 03 11:58:59 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Flow 'volume_create_manager' (28b2efd5-5756-419d-8e96-bebb69d9128f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228b9b98-ea8d-4905-9e5a-69188cb8cc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228b9b98-ea8d-4905-9e5a-69188cb8cc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2075034432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae8f4a5-33b8-420f-9eca-034aca38e8b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798e941ea1ad4e88b41dd1f25db28c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:00Z,use_quota=True,user_id='5008293c434f4af9bfb475b0172a36dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588d063f-9928-4f39-ac21-27e1955053c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588d063f-9928-4f39-ac21-27e1955053c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc2b0f67-ec9d-4b60-82cc-a47b8b8caba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc2b0f67-ec9d-4b60-82cc-a47b8b8caba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ae8f4a5-33b8-420f-9eca-034aca38e8b9', 'volume_name': 'volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d570b81-84eb-457e-ad4c-3f7f6aa0b35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d570b81-84eb-457e-ad4c-3f7f6aa0b35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed982c4-40d9-4978-826a-65f1e5ff55c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:00 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Volume 9ae8f4a5-33b8-420f-9eca-034aca38e8b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9', 'volume_size': 1} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2075034432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae8f4a5-33b8-420f-9eca-034aca38e8b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798e941ea1ad4e88b41dd1f25db28c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:00Z,use_quota=True,user_id='5008293c434f4af9bfb475b0172a36dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Creating volume 9ae8f4a5-33b8-420f-9eca-034aca38e8b9 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:59:00 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:00 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9 1073741824 Jun 03 11:59:00 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:00 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_874u353adevstack@QuobyteHD" returned: 0 in 0.879s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] 0249897e-120c-42bb-b1a8-f517317c1907 was qcow2, converting to raw {{(pid=86724) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 03 11:59:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_874u353adevstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:00 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_874u353adevstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 Jun 03 11:59:00 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:01 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9 1073741824" returned: 0 in 0.985s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:01 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9 Jun 03 11:59:01 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:02 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9" returned: 0 in 1.021s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:02 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:59:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed982c4-40d9-4978-826a-65f1e5ff55c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317063c2-53a8-40d8-992b-a8c7866e6523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:02 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Volume volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9 (9ae8f4a5-33b8-420f-9eca-034aca38e8b9): created successfully Jun 03 11:59:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317063c2-53a8-40d8-992b-a8c7866e6523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Flow 'volume_create_manager' (28b2efd5-5756-419d-8e96-bebb69d9128f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:02 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-abb8b3ae-81f5-4cb9-9995-d3855897ddf6 tempest-SnapshotMetadataTestJSON-1524159275 None] Created volume successfully. Jun 03 11:59:02 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_874u353adevstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32" returned: 0 in 2.483s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:02 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_874u353adevstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 11:59:02 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Converted 112.00 MB image at 45.09 MB/s Jun 03 11:59:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:02 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 1G Jun 03 11:59:02 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-43464716-7bd0-43d6-a2d5-0f61a986b8cc tempest-SnapshotMetadataTestJSON-1524159275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-43464716-7bd0-43d6-a2d5-0f61a986b8cc tempest-SnapshotMetadataTestJSON-1524159275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-43464716-7bd0-43d6-a2d5-0f61a986b8cc tempest-SnapshotMetadataTestJSON-1524159275 None] Creating offline snapshot 603975a6-9761-4cd1-b33c-a9db455fb22a of volume 9ae8f4a5-33b8-420f-9eca-034aca38e8b9 {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 11:59:03 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad66a8a4-6287-4686-a986-ba3c12ea32e5]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-43464716-7bd0-43d6-a2d5-0f61a986b8cc tempest-SnapshotMetadataTestJSON-1524159275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:03 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9 Jun 03 11:59:03 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:03 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 1G" returned: 0 in 1.121s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:03 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1165c1fe-7b69-4ab0-bb0e-847318c89604]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:04 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 Jun 03 11:59:04 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:04 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-43464716-7bd0-43d6-a2d5-0f61a986b8cc tempest-SnapshotMetadataTestJSON-1524159275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9" returned: 0 in 1.027s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-43464716-7bd0-43d6-a2d5-0f61a986b8cc tempest-SnapshotMetadataTestJSON-1524159275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.603975a6-9761-4cd1-b33c-a9db455fb22a 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:04 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.603975a6-9761-4cd1-b33c-a9db455fb22a 1G Jun 03 11:59:04 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:04 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32" returned: 0 in 0.869s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:05 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 Jun 03 11:59:05 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:05 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32" returned: 1 in 0.894s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 11:59:05 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Downloaded image 0249897e-120c-42bb-b1a8-f517317c1907 ((None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}])) to volume 82bf12c2-4e24-4a5f-aec8-5af8d5281e32 successfully. {{(pid=86724) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 03 11:59:05 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:05 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Temporary image 0249897e-120c-42bb-b1a8-f517317c1907 for user 47d9db5178db42108b039a2b7d0dc2b9 is deleted. {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 03 11:59:05 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Marking volume 82bf12c2-4e24-4a5f-aec8-5af8d5281e32 as bootable. {{(pid=86724) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 03 11:59:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-43464716-7bd0-43d6-a2d5-0f61a986b8cc tempest-SnapshotMetadataTestJSON-1524159275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.603975a6-9761-4cd1-b33c-a9db455fb22a 1G" returned: 0 in 1.015s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-43464716-7bd0-43d6-a2d5-0f61a986b8cc tempest-SnapshotMetadataTestJSON-1524159275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.603975a6-9761-4cd1-b33c-a9db455fb22a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:05 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Copying metadata from image 0249897e-120c-42bb-b1a8-f517317c1907 to 82bf12c2-4e24-4a5f-aec8-5af8d5281e32. {{(pid=86724) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 03 11:59:05 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Creating volume glance metadata for volume 82bf12c2-4e24-4a5f-aec8-5af8d5281e32 backed by image 0249897e-120c-42bb-b1a8-f517317c1907 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0249897e-120c-42bb-b1a8-f517317c1907', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86724) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 03 11:59:05 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.603975a6-9761-4cd1-b33c-a9db455fb22a Jun 03 11:59:05 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3792120-ba41-470a-9b5f-e23d883bc954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32', 'volume_size': 1, 'image_id': '0249897e-120c-42bb-b1a8-f517317c1907', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e70522cb7d6245e7970314b42bb711e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0249897e-120c-42bb-b1a8-f517317c1907', 'created_at': datetime.datetime(2026, 6, 3, 9, 43, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 9, 43, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0249897e-120c-42bb-b1a8-f517317c1907/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420a1388-be2e-44fb-8f51-79c01a776337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:05 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Volume volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 (82bf12c2-4e24-4a5f-aec8-5af8d5281e32): created successfully Jun 03 11:59:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420a1388-be2e-44fb-8f51-79c01a776337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Flow 'volume_create_manager' (cb39fd33-dae3-4992-8880-e3671869a660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:05 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-ce46c26e-4b5c-40d9-b7de-8599591a8966 tempest-VolumesGetTest-1657425241 None] Created volume successfully. Jun 03 11:59:06 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-eb819db7-d87c-41c4-8050-79f9768499d2 tempest-GroupsV314Test-314243775 None] Group tempest-GroupsV314Test-Group-1596141774: creating Jun 03 11:59:06 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-eb819db7-d87c-41c4-8050-79f9768499d2 tempest-GroupsV314Test-314243775 None] Group tempest-GroupsV314Test-Group-1596141774: created successfully Jun 03 11:59:06 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-eb819db7-d87c-41c4-8050-79f9768499d2 tempest-GroupsV314Test-314243775 None] Create group completed successfully. Jun 03 11:59:06 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-43464716-7bd0-43d6-a2d5-0f61a986b8cc tempest-SnapshotMetadataTestJSON-1524159275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.603975a6-9761-4cd1-b33c-a9db455fb22a" returned: 0 in 0.716s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:06 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-43464716-7bd0-43d6-a2d5-0f61a986b8cc tempest-SnapshotMetadataTestJSON-1524159275 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.603975a6-9761-4cd1-b33c-a9db455fb22a is being set with open permissions: ugo+rw Jun 03 11:59:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-43464716-7bd0-43d6-a2d5-0f61a986b8cc tempest-SnapshotMetadataTestJSON-1524159275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.603975a6-9761-4cd1-b33c-a9db455fb22a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:06 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.603975a6-9761-4cd1-b33c-a9db455fb22a Jun 03 11:59:06 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:07 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-43464716-7bd0-43d6-a2d5-0f61a986b8cc tempest-SnapshotMetadataTestJSON-1524159275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.603975a6-9761-4cd1-b33c-a9db455fb22a" returned: 0 in 0.638s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-43464716-7bd0-43d6-a2d5-0f61a986b8cc tempest-SnapshotMetadataTestJSON-1524159275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:07 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.info Jun 03 11:59:07 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Flow 'volume_create_manager' (2e8abaf8-6d95-4ec6-9035-5d06cf19be17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86bdb39d-8018-4901-80b3-51b5775b1fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86bdb39d-8018-4901-80b3-51b5775b1fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-707515912',display_name='tempest-VolumesGetTest-Volume-1524696040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e31d0d-7125-48f8-a238-59aae501729d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfef256f739b47e0bcb9b08633c1941e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:08Z,use_quota=True,user_id='47d9db5178db42108b039a2b7d0dc2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78bcd5b0-a493-463a-8b95-ee8a7f6a5d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78bcd5b0-a493-463a-8b95-ee8a7f6a5d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40eb56c-52ea-4aa7-b3c4-a9c09d0ebaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40eb56c-52ea-4aa7-b3c4-a9c09d0ebaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57e31d0d-7125-48f8-a238-59aae501729d', 'volume_name': 'volume-57e31d0d-7125-48f8-a238-59aae501729d', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c2ad26-e8e8-45f6-bf1d-f0c3b1aacb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c2ad26-e8e8-45f6-bf1d-f0c3b1aacb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb63a3d-51f3-4f34-a8a0-6dabfe076cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:07 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Volume 57e31d0d-7125-48f8-a238-59aae501729d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57e31d0d-7125-48f8-a238-59aae501729d', 'volume_size': 1} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Flow 'volume_create_manager' (5edafd5a-0cd2-47af-bd6c-af3739b4e8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae2a54e-44b4-4d58-9490-86790bfb0371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae2a54e-44b4-4d58-9490-86790bfb0371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1253813129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ba1664e7-2e7b-4ccc-8b1f-2e8fc89e08c8,host='devstack@QuobyteHD#QuobyteHD',id=f1c7de41-babf-4779-a0d0-db4b163db1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba66d1db12ba4edcb78f822b3aea997d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:08Z,use_quota=True,user_id='6fd4720d0df74551afd2120c8e91e70d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c4f411f-83b7-4211-b538-93b749f49676),volume_type_id=9c4f411f-83b7-4211-b538-93b749f49676)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8263095e-8c53-4d8b-9556-893fa8c6e545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8263095e-8c53-4d8b-9556-893fa8c6e545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e84364a-16be-4387-a6b9-307c871884f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e84364a-16be-4387-a6b9-307c871884f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1c7de41-babf-4779-a0d0-db4b163db1f7', 'volume_name': 'volume-f1c7de41-babf-4779-a0d0-db4b163db1f7', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8521594f-4233-43f5-8667-76c74a409e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8521594f-4233-43f5-8667-76c74a409e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d1e9b3-888d-4920-8fd2-1e3a8783ea36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:07 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Volume f1c7de41-babf-4779-a0d0-db4b163db1f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1c7de41-babf-4779-a0d0-db4b163db1f7', 'volume_size': 1} Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:07 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-43464716-7bd0-43d6-a2d5-0f61a986b8cc tempest-SnapshotMetadataTestJSON-1524159275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.info" returned: 0 in 0.732s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:07 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-43464716-7bd0-43d6-a2d5-0f61a986b8cc tempest-SnapshotMetadataTestJSON-1524159275 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.info is being set with open permissions: ugo+rw Jun 03 11:59:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-43464716-7bd0-43d6-a2d5-0f61a986b8cc tempest-SnapshotMetadataTestJSON-1524159275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:07 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.info Jun 03 11:59:07 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:08 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-43464716-7bd0-43d6-a2d5-0f61a986b8cc tempest-SnapshotMetadataTestJSON-1524159275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.info" returned: 0 in 0.616s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-43464716-7bd0-43d6-a2d5-0f61a986b8cc tempest-SnapshotMetadataTestJSON-1524159275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.871s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.766s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-707515912',display_name='tempest-VolumesGetTest-Volume-1524696040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e31d0d-7125-48f8-a238-59aae501729d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfef256f739b47e0bcb9b08633c1941e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:08Z,use_quota=True,user_id='47d9db5178db42108b039a2b7d0dc2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:59:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Creating volume 57e31d0d-7125-48f8-a238-59aae501729d {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:59:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:59:08 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:59:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-57e31d0d-7125-48f8-a238-59aae501729d 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:08 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-57e31d0d-7125-48f8-a238-59aae501729d 1073741824 Jun 03 11:59:08 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:08 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-43464716-7bd0-43d6-a2d5-0f61a986b8cc tempest-SnapshotMetadataTestJSON-1524159275 None] Create snapshot completed successfully Jun 03 11:59:09 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-57e31d0d-7125-48f8-a238-59aae501729d 1073741824" returned: 0 in 1.006s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-57e31d0d-7125-48f8-a238-59aae501729d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:09 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-57e31d0d-7125-48f8-a238-59aae501729d Jun 03 11:59:09 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] Acquiring lock "cinder-603975a6-9761-4cd1-b33c-a9db455fb22a-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] Lock "cinder-603975a6-9761-4cd1-b33c-a9db455fb22a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] Acquiring lock "cinder-quobyte-9ae8f4a5-33b8-420f-9eca-034aca38e8b9" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] Lock "cinder-quobyte-9ae8f4a5-33b8-420f-9eca-034aca38e8b9" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] Acquiring lock "cinder-quobyte-603975a6-9761-4cd1-b33c-a9db455fb22a" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] Lock "cinder-quobyte-603975a6-9761-4cd1-b33c-a9db455fb22a" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] Deleting offline snapshot 603975a6-9761-4cd1-b33c-a9db455fb22a of volume 9ae8f4a5-33b8-420f-9eca-034aca38e8b9 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] snapshot_file for this snap is: volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.603975a6-9761-4cd1-b33c-a9db455fb22a {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c476740d-05e3-47bc-b6f4-0a677417bd31]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.603975a6-9761-4cd1-b33c-a9db455fb22a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:10 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-57e31d0d-7125-48f8-a238-59aae501729d" returned: 0 in 0.843s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.619s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ba1664e7-2e7b-4ccc-8b1f-2e8fc89e08c8,created_at=2026-06-03T09:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1253813129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ba1664e7-2e7b-4ccc-8b1f-2e8fc89e08c8,host='devstack@QuobyteHD#QuobyteHD',id=f1c7de41-babf-4779-a0d0-db4b163db1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba66d1db12ba4edcb78f822b3aea997d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:08Z,use_quota=True,user_id='6fd4720d0df74551afd2120c8e91e70d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c4f411f-83b7-4211-b538-93b749f49676),volume_type_id=9c4f411f-83b7-4211-b538-93b749f49676)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Creating volume f1c7de41-babf-4779-a0d0-db4b163db1f7 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:10 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.603975a6-9761-4cd1-b33c-a9db455fb22a Jun 03 11:59:10 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:59:10 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb63a3d-51f3-4f34-a8a0-6dabfe076cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57e31d0d-7125-48f8-a238-59aae501729d', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:10 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 1073741824 Jun 03 11:59:10 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af51d0b-ab45-4680-b7a3-020de863f213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:10 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Volume volume-57e31d0d-7125-48f8-a238-59aae501729d (57e31d0d-7125-48f8-a238-59aae501729d): created successfully Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af51d0b-ab45-4680-b7a3-020de863f213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:10 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Flow 'volume_create_manager' (2e8abaf8-6d95-4ec6-9035-5d06cf19be17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:10 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-1c81056e-9872-4e57-b259-92c19cbfe186 tempest-VolumesGetTest-1657425241 None] Created volume successfully. Jun 03 11:59:11 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-161234f3-1d69-483e-8e23-5eeedfbc37bc tempest-VolumesGetTest-1657425241 None] Acquiring lock "cinder-57e31d0d-7125-48f8-a238-59aae501729d-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:11 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-161234f3-1d69-483e-8e23-5eeedfbc37bc tempest-VolumesGetTest-1657425241 None] Lock "cinder-57e31d0d-7125-48f8-a238-59aae501729d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:11 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-161234f3-1d69-483e-8e23-5eeedfbc37bc tempest-VolumesGetTest-1657425241 None] Acquiring lock "cinder-quobyte-57e31d0d-7125-48f8-a238-59aae501729d" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:11 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-161234f3-1d69-483e-8e23-5eeedfbc37bc tempest-VolumesGetTest-1657425241 None] Lock "cinder-quobyte-57e31d0d-7125-48f8-a238-59aae501729d" acquired by "delete_volume" :: waited 0.039s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:11 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b61ec0-0c29-4f9d-b7a9-4749b25bf91e]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-161234f3-1d69-483e-8e23-5eeedfbc37bc tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-57e31d0d-7125-48f8-a238-59aae501729d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:11 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.603975a6-9761-4cd1-b33c-a9db455fb22a" returned: 0 in 1.197s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:59:11 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cb2fcf-5ca1-4676-b24d-4346a64a3fe3]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:11 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-57e31d0d-7125-48f8-a238-59aae501729d Jun 03 11:59:11 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:11 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9 Jun 03 11:59:11 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:11 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 1073741824" returned: 0 in 1.195s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:11 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 Jun 03 11:59:11 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:12 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7" returned: 0 in 0.894s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:12 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] <== create_volume: return (2161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:59:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.174s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:12 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-161234f3-1d69-483e-8e23-5eeedfbc37bc tempest-VolumesGetTest-1657425241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-57e31d0d-7125-48f8-a238-59aae501729d" returned: 0 in 1.308s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-161234f3-1d69-483e-8e23-5eeedfbc37bc tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-57e31d0d-7125-48f8-a238-59aae501729d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d1e9b3-888d-4920-8fd2-1e3a8783ea36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1c7de41-babf-4779-a0d0-db4b163db1f7', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38da8953-6621-4419-b60b-5f138747433a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:12 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-57e31d0d-7125-48f8-a238-59aae501729d Jun 03 11:59:12 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:12 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Volume volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 (f1c7de41-babf-4779-a0d0-db4b163db1f7): created successfully Jun 03 11:59:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38da8953-6621-4419-b60b-5f138747433a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:12 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Flow 'volume_create_manager' (5edafd5a-0cd2-47af-bd6c-af3739b4e8b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:12 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-13a6706e-aa99-44ca-9d13-c056d8c78b13 tempest-GroupsV314Test-314243775 None] Created volume successfully. Jun 03 11:59:12 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9" returned: 0 in 1.273s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.603975a6-9761-4cd1-b33c-a9db455fb22a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:12 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.603975a6-9761-4cd1-b33c-a9db455fb22a Jun 03 11:59:12 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:13 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-161234f3-1d69-483e-8e23-5eeedfbc37bc tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-57e31d0d-7125-48f8-a238-59aae501729d" returned: 0 in 0.694s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:13 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-161234f3-1d69-483e-8e23-5eeedfbc37bc tempest-VolumesGetTest-1657425241 None] Lock "cinder-quobyte-57e31d0d-7125-48f8-a238-59aae501729d" released by "delete_volume" :: held 2.066s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:13 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-161234f3-1d69-483e-8e23-5eeedfbc37bc tempest-VolumesGetTest-1657425241 None] Created reservations ['ba6a5916-6030-4aac-a7c9-4d7f2beaddb2', '42e74da8-471a-4f08-9317-3d347eab1e68', '7daddfce-0a50-4fed-98d5-6bc7851c18e9', '989356ef-4648-4d50-bc3d-b18e4528e627'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:59:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-161234f3-1d69-483e-8e23-5eeedfbc37bc tempest-VolumesGetTest-1657425241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-161234f3-1d69-483e-8e23-5eeedfbc37bc tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:13 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-161234f3-1d69-483e-8e23-5eeedfbc37bc tempest-VolumesGetTest-1657425241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:13 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-161234f3-1d69-483e-8e23-5eeedfbc37bc tempest-VolumesGetTest-1657425241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-161234f3-1d69-483e-8e23-5eeedfbc37bc tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-161234f3-1d69-483e-8e23-5eeedfbc37bc tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:13 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.603975a6-9761-4cd1-b33c-a9db455fb22a" returned: 0 in 0.817s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.603975a6-9761-4cd1-b33c-a9db455fb22a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:13 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:59:13 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:13 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.603975a6-9761-4cd1-b33c-a9db455fb22a Jun 03 11:59:13 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:13 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] Acquiring lock "cinder-82bf12c2-4e24-4a5f-aec8-5af8d5281e32-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:13 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] Lock "cinder-82bf12c2-4e24-4a5f-aec8-5af8d5281e32-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:13 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] Acquiring lock "cinder-quobyte-82bf12c2-4e24-4a5f-aec8-5af8d5281e32" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:14 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] Lock "cinder-quobyte-82bf12c2-4e24-4a5f-aec8-5af8d5281e32" acquired by "delete_volume" :: waited 0.035s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:14 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[11288409-7e88-48a5-a25f-c0410b1fd643]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:14 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 Jun 03 11:59:14 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:14 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-161234f3-1d69-483e-8e23-5eeedfbc37bc tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.009s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:14 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-161234f3-1d69-483e-8e23-5eeedfbc37bc tempest-VolumesGetTest-1657425241 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:59:14 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-161234f3-1d69-483e-8e23-5eeedfbc37bc tempest-VolumesGetTest-1657425241 None] Deleted volume successfully. Jun 03 11:59:14 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-161234f3-1d69-483e-8e23-5eeedfbc37bc tempest-VolumesGetTest-1657425241 None] Lock "cinder-57e31d0d-7125-48f8-a238-59aae501729d-delete_volume" released by "delete_volume" :: held 3.442s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:14 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9.603975a6-9761-4cd1-b33c-a9db455fb22a" returned: 0 in 1.085s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:14 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] Lock "cinder-quobyte-603975a6-9761-4cd1-b33c-a9db455fb22a" released by "_delete_snapshot" :: held 4.592s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:14 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] Lock "cinder-quobyte-9ae8f4a5-33b8-420f-9eca-034aca38e8b9" released by "delete_snapshot" :: held 4.655s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:14 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] Created reservations ['851d7b56-da93-4b1a-aaa6-c38f4f4f87c7', '57a83c7c-61b1-418b-878e-6b0e08f97f4b', '1d1cf5f9-c1a4-4c84-965b-b3cd3622c4c1', '5849d256-09a8-48af-8907-08a5f1afe4bb'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:59:15 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] Delete snapshot completed successfully. Jun 03 11:59:15 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-66a4d526-6147-4756-8c91-dcbdf1d7a306 tempest-SnapshotMetadataTestJSON-1524159275 None] Lock "cinder-603975a6-9761-4cd1-b33c-a9db455fb22a-delete_snapshot" released by "delete_snapshot" :: held 5.128s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:15 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Cloning volume f1c7de41-babf-4779-a0d0-db4b163db1f7 to volume cdb25982-2901-4b50-b9c1-56722e9c0e94 Jun 03 11:59:15 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:59:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Flow 'volume_create_manager' (e1685142-ecec-46ef-aaba-e90d830f4475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc920ac-e264-425c-b94e-58d944dd0cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:15 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32" returned: 0 in 1.256s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc920ac-e264-425c-b94e-58d944dd0cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-762282181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cfe99c8-8270-4eb6-909f-966dca78c22d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a8c6c009d1483da8aa7c9619c8349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:15Z,use_quota=True,user_id='ddf3d9669a524f89aaac8b4024a16d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef1bc91-ccfb-44fc-8474-8b7b0d910fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef1bc91-ccfb-44fc-8474-8b7b0d910fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68db8ff7-7831-48c8-a6e8-ff9bc23f3b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68db8ff7-7831-48c8-a6e8-ff9bc23f3b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cfe99c8-8270-4eb6-909f-966dca78c22d', 'volume_name': 'volume-5cfe99c8-8270-4eb6-909f-966dca78c22d', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4dfb60d-c101-4906-bb51-e6548ae19e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4dfb60d-c101-4906-bb51-e6548ae19e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642c36be-205f-49b0-9cf5-59d74bf20b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:15 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Volume 5cfe99c8-8270-4eb6-909f-966dca78c22d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cfe99c8-8270-4eb6-909f-966dca78c22d', 'volume_size': 1} Jun 03 11:59:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Creating offline snapshot 7f445192-616f-499c-ae48-ac7b12c1bdad of volume f1c7de41-babf-4779-a0d0-db4b163db1f7 {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 11:59:15 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7e3390-eadc-490f-ba60-f35a07c7bf83]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:15 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 Jun 03 11:59:15 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:15 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 Jun 03 11:59:15 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:16 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32" returned: 1 in 0.758s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 11:59:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:16 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32 Jun 03 11:59:16 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-90f0b84c-e050-4145-8edd-ac362949093a tempest-SnapshotMetadataTestJSON-1524159275 None] Acquiring lock "cinder-9ae8f4a5-33b8-420f-9eca-034aca38e8b9-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-90f0b84c-e050-4145-8edd-ac362949093a tempest-SnapshotMetadataTestJSON-1524159275 None] Lock "cinder-9ae8f4a5-33b8-420f-9eca-034aca38e8b9-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:16 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=134,cinder:INSERT=32,cinder:UPDATE=156,cinder:DELETE=10 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:59:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-90f0b84c-e050-4145-8edd-ac362949093a tempest-SnapshotMetadataTestJSON-1524159275 None] Acquiring lock "cinder-quobyte-9ae8f4a5-33b8-420f-9eca-034aca38e8b9" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-90f0b84c-e050-4145-8edd-ac362949093a tempest-SnapshotMetadataTestJSON-1524159275 None] Lock "cinder-quobyte-9ae8f4a5-33b8-420f-9eca-034aca38e8b9" acquired by "delete_volume" :: waited 0.025s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:16 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a3838b-26ca-4132-aa04-1b85652ddfe2]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-90f0b84c-e050-4145-8edd-ac362949093a tempest-SnapshotMetadataTestJSON-1524159275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:16 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7" returned: 0 in 0.990s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:16 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad 1G Jun 03 11:59:16 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:16 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9 Jun 03 11:59:16 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:16 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-82bf12c2-4e24-4a5f-aec8-5af8d5281e32" returned: 0 in 0.828s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] Lock "cinder-quobyte-82bf12c2-4e24-4a5f-aec8-5af8d5281e32" released by "delete_volume" :: held 2.963s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:17 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:UPDATE=140,cinder:SELECT=122,cinder:INSERT=48,cinder:DELETE=11 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 11:59:17 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] Created reservations ['d6fdd4ea-7017-4396-8367-b2f62b9431f9', '14e5ae45-1306-40be-abdb-f23a08673af5', 'b613e883-e760-408f-aaf9-22b9ce2c3969', '11f3bca0-6d3c-4860-b5b5-de0e0ffd6388'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:59:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:17 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:59:17 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:17 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-90f0b84c-e050-4145-8edd-ac362949093a tempest-SnapshotMetadataTestJSON-1524159275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9" returned: 0 in 0.906s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-90f0b84c-e050-4145-8edd-ac362949093a tempest-SnapshotMetadataTestJSON-1524159275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:17 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9 Jun 03 11:59:17 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:17 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad 1G" returned: 0 in 1.243s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:17 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad Jun 03 11:59:17 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:18 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.923s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:18 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:59:18 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] Deleted volume successfully. Jun 03 11:59:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-418650fe-db9d-41e4-8406-03ba8c3c65ec tempest-VolumesGetTest-1657425241 None] Lock "cinder-82bf12c2-4e24-4a5f-aec8-5af8d5281e32-delete_volume" released by "delete_volume" :: held 4.240s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:18 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-90f0b84c-e050-4145-8edd-ac362949093a tempest-SnapshotMetadataTestJSON-1524159275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9ae8f4a5-33b8-420f-9eca-034aca38e8b9" returned: 0 in 0.948s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-90f0b84c-e050-4145-8edd-ac362949093a tempest-SnapshotMetadataTestJSON-1524159275 None] Lock "cinder-quobyte-9ae8f4a5-33b8-420f-9eca-034aca38e8b9" released by "delete_volume" :: held 1.920s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:18 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-90f0b84c-e050-4145-8edd-ac362949093a tempest-SnapshotMetadataTestJSON-1524159275 None] Created reservations ['434d5a6c-4bea-4c54-b657-6161b821839e', '6c422b26-daf2-4ffc-ba1f-ebd6c86002b6', '3eda36ef-8e76-4112-b372-d76fd6742157', '54a78c61-8e76-4eff-a1dd-9d91648c740c'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:59:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-90f0b84c-e050-4145-8edd-ac362949093a tempest-SnapshotMetadataTestJSON-1524159275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-90f0b84c-e050-4145-8edd-ac362949093a tempest-SnapshotMetadataTestJSON-1524159275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-90f0b84c-e050-4145-8edd-ac362949093a tempest-SnapshotMetadataTestJSON-1524159275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-90f0b84c-e050-4145-8edd-ac362949093a tempest-SnapshotMetadataTestJSON-1524159275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-90f0b84c-e050-4145-8edd-ac362949093a tempest-SnapshotMetadataTestJSON-1524159275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-90f0b84c-e050-4145-8edd-ac362949093a tempest-SnapshotMetadataTestJSON-1524159275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:18 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:59:18 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:18 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad" returned: 0 in 1.028s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:18 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad is being set with open permissions: ugo+rw: NotImplementedError Jun 03 11:59:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:18 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad Jun 03 11:59:18 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:19 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-90f0b84c-e050-4145-8edd-ac362949093a tempest-SnapshotMetadataTestJSON-1524159275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.093s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:19 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-90f0b84c-e050-4145-8edd-ac362949093a tempest-SnapshotMetadataTestJSON-1524159275 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:59:19 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-90f0b84c-e050-4145-8edd-ac362949093a tempest-SnapshotMetadataTestJSON-1524159275 None] Deleted volume successfully. Jun 03 11:59:19 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-90f0b84c-e050-4145-8edd-ac362949093a tempest-SnapshotMetadataTestJSON-1524159275 None] Lock "cinder-9ae8f4a5-33b8-420f-9eca-034aca38e8b9-delete_volume" released by "delete_volume" :: held 3.380s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:19 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad" returned: 0 in 1.229s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:20 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.info Jun 03 11:59:20 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:20 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.info" returned: 0 in 0.820s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:20 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.info is being set with open permissions: ugo+rw: NotImplementedError Jun 03 11:59:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:20 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.info Jun 03 11:59:20 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:21 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.info" returned: 0 in 0.864s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:21 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Acquiring lock "cinder-quobyte-cdb25982-2901-4b50-b9c1-56722e9c0e94" by "_copy_volume_from_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:21 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Lock "cinder-quobyte-cdb25982-2901-4b50-b9c1-56722e9c0e94" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] snapshot: 7f445192-616f-499c-ae48-ac7b12c1bdad, volume: cdb25982-2901-4b50-b9c1-56722e9c0e94, {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 11:59:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:21 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[43234dca-0c67-48ae-b7fd-06c216d1819f]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:22 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:59:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Flow 'volume_create_manager' (8983da73-93a8-4dc8-a714-02b7856c528f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16d3fee-725c-467d-a8bd-f7ed16c4cddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:22 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad Jun 03 11:59:22 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16d3fee-725c-467d-a8bd-f7ed16c4cddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-697527552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5792e594-820e-4f55-973f-2c0becd53a58,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='698bacdf5f1f4abebd1468f2ac1f71c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:22Z,use_quota=True,user_id='9006e6e5f62d4dd7826b4b603a770c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbfa9b07-a709-43c7-a688-9d4abe7a79dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbfa9b07-a709-43c7-a688-9d4abe7a79dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f805a8c7-5a64-469f-847a-a52043ad09fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f805a8c7-5a64-469f-847a-a52043ad09fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5792e594-820e-4f55-973f-2c0becd53a58', 'volume_name': 'volume-5792e594-820e-4f55-973f-2c0becd53a58', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a55fece-dfcd-412a-80f4-9062cbcc4a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a55fece-dfcd-412a-80f4-9062cbcc4a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2328bc6e-e071-409a-a892-ed15ee05527a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:22 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Volume 5792e594-820e-4f55-973f-2c0becd53a58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5792e594-820e-4f55-973f-2c0becd53a58', 'volume_size': 1} Jun 03 11:59:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:22 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad" returned: 0 in 0.903s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c7de41-babf-4779-a0d0-db4b163db1f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:59:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] will copy from snapshot at /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 11:59:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Creating direct copy from snapshot {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 11:59:22 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec333f08-ef9e-4f0d-9964-ac25a61a46d6]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:23 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 Jun 03 11:59:23 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:23 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7" returned: 0 in 0.947s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:23 devstack cinder-volume[86724]: DEBUG cinder.utils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Path /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdb25982-2901-4b50-b9c1-56722e9c0e94 not found in is_blk_device check {{(pid=86724) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 03 11:59:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdb25982-2901-4b50-b9c1-56722e9c0e94 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:23 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdb25982-2901-4b50-b9c1-56722e9c0e94 Jun 03 11:59:23 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:27 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:59:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Flow 'volume_create_manager' (c6bca956-f7df-45ed-b4c1-bacc5c0d1b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edaf823d-62d3-4e47-a20c-81f62de27b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edaf823d-62d3-4e47-a20c-81f62de27b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-790152998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa01fba-3178-4947-bb82-a118d3900550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dc3fc7a0a14cf3b3a690ba4e29b37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:28Z,use_quota=True,user_id='509ecbce97fb41d6abff34dabd3b56f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb2aad1-850c-45a4-99f4-89f64939b17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb2aad1-850c-45a4-99f4-89f64939b17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9deb7296-ceed-47ea-ab4e-be7822832d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9deb7296-ceed-47ea-ab4e-be7822832d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fa01fba-3178-4947-bb82-a118d3900550', 'volume_name': 'volume-8fa01fba-3178-4947-bb82-a118d3900550', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7b394d3-1517-44c2-8556-da18a746b886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7b394d3-1517-44c2-8556-da18a746b886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8322dc1a-b7df-4469-b9b9-3c6f1ba974c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:28 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Volume 8fa01fba-3178-4947-bb82-a118d3900550: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fa01fba-3178-4947-bb82-a118d3900550', 'volume_size': 1} Jun 03 11:59:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:29 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdb25982-2901-4b50-b9c1-56722e9c0e94" returned: 0 in 5.612s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:29 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[65565cd0-21af-4e44-bd05-92b3828171c8]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:29 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 Jun 03 11:59:29 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:30 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7" returned: 0 in 0.869s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:30 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Image conversion details: src /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7, size 1024.00 MB, duration 5.61 sec, destination /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdb25982-2901-4b50-b9c1-56722e9c0e94 {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 11:59:30 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Converted 1024.00 MB image at 182.43 MB/s Jun 03 11:59:30 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdb25982-2901-4b50-b9c1-56722e9c0e94 is being set with open permissions: ugo+rw: NotImplementedError Jun 03 11:59:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdb25982-2901-4b50-b9c1-56722e9c0e94 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:30 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdb25982-2901-4b50-b9c1-56722e9c0e94 Jun 03 11:59:30 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:30 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdb25982-2901-4b50-b9c1-56722e9c0e94" returned: 0 in 0.603s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Lock "cinder-quobyte-cdb25982-2901-4b50-b9c1-56722e9c0e94" released by "_copy_volume_from_snapshot" :: held 9.101s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Acquiring lock "cinder-quobyte-7f445192-616f-499c-ae48-ac7b12c1bdad" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Lock "cinder-quobyte-7f445192-616f-499c-ae48-ac7b12c1bdad" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:30 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Deleting offline snapshot 7f445192-616f-499c-ae48-ac7b12c1bdad of volume f1c7de41-babf-4779-a0d0-db4b163db1f7 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 11:59:31 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] snapshot_file for this snap is: volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 11:59:31 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c394e963-dadf-4ebb-bc2f-35162fd8667d]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:31 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad Jun 03 11:59:31 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:31 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad" returned: 0 in 0.737s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:31 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c7de41-babf-4779-a0d0-db4b163db1f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 11:59:31 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de8f89c-1f48-4b4a-a947-299ae2bb2b7c]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:31 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 Jun 03 11:59:31 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:32 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7" returned: 0 in 0.718s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:32 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad Jun 03 11:59:32 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:33 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad" returned: 0 in 0.683s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:33 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad Jun 03 11:59:33 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:33 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7.7f445192-616f-499c-ae48-ac7b12c1bdad" returned: 0 in 0.591s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:33 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Lock "cinder-quobyte-7f445192-616f-499c-ae48-ac7b12c1bdad" released by "_delete_snapshot" :: held 2.856s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.595s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.396s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:33 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-762282181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cfe99c8-8270-4eb6-909f-966dca78c22d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a8c6c009d1483da8aa7c9619c8349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:15Z,use_quota=True,user_id='ddf3d9669a524f89aaac8b4024a16d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:59:33 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Creating volume 5cfe99c8-8270-4eb6-909f-966dca78c22d {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:59:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:33 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:33 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:33 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:59:33 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:59:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5cfe99c8-8270-4eb6-909f-966dca78c22d 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:33 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5cfe99c8-8270-4eb6-909f-966dca78c22d 1073741824 Jun 03 11:59:33 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:33 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-7e41e298-bbee-4703-9eba-f5444022e86a tempest-GroupsV314Test-314243775 None] Create group from source-group-ba1664e7-2e7b-4ccc-8b1f-2e8fc89e08c8 completed successfully. Jun 03 11:59:34 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5cfe99c8-8270-4eb6-909f-966dca78c22d 1073741824" returned: 0 in 0.774s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5cfe99c8-8270-4eb6-909f-966dca78c22d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:34 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5cfe99c8-8270-4eb6-909f-966dca78c22d Jun 03 11:59:34 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:35 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fb5c742e-22e2-4dd8-aa5e-50e2dfb150a2 tempest-GroupsV314Test-314243775 None] Acquiring lock "cinder-quobyte-cdb25982-2901-4b50-b9c1-56722e9c0e94" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:35 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fb5c742e-22e2-4dd8-aa5e-50e2dfb150a2 tempest-GroupsV314Test-314243775 None] Lock "cinder-quobyte-cdb25982-2901-4b50-b9c1-56722e9c0e94" acquired by "delete_volume" :: waited 0.016s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:35 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9fd1b3-d04a-48af-8b03-701b0bc599bb]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fb5c742e-22e2-4dd8-aa5e-50e2dfb150a2 tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdb25982-2901-4b50-b9c1-56722e9c0e94 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:35 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5cfe99c8-8270-4eb6-909f-966dca78c22d" returned: 0 in 0.632s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:35 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:59:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.100s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:35 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-697527552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5792e594-820e-4f55-973f-2c0becd53a58,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='698bacdf5f1f4abebd1468f2ac1f71c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:22Z,use_quota=True,user_id='9006e6e5f62d4dd7826b4b603a770c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:59:35 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Creating volume 5792e594-820e-4f55-973f-2c0becd53a58 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:59:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:35 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:35 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:35 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:59:35 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:59:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5792e594-820e-4f55-973f-2c0becd53a58 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:35 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642c36be-205f-49b0-9cf5-59d74bf20b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cfe99c8-8270-4eb6-909f-966dca78c22d', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:35 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7350ac11-b185-45f5-941b-55bac481192f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:35 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5792e594-820e-4f55-973f-2c0becd53a58 1073741824 Jun 03 11:59:35 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:35 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Volume volume-5cfe99c8-8270-4eb6-909f-966dca78c22d (5cfe99c8-8270-4eb6-909f-966dca78c22d): created successfully Jun 03 11:59:35 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7350ac11-b185-45f5-941b-55bac481192f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:35 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Flow 'volume_create_manager' (e1685142-ecec-46ef-aaba-e90d830f4475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:35 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-ed90d880-6ffe-429e-be60-0996b785fb15 tempest-VolumesActionsTest-111485632 None] Created volume successfully. Jun 03 11:59:35 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdb25982-2901-4b50-b9c1-56722e9c0e94 Jun 03 11:59:35 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:36 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fb5c742e-22e2-4dd8-aa5e-50e2dfb150a2 tempest-GroupsV314Test-314243775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdb25982-2901-4b50-b9c1-56722e9c0e94" returned: 0 in 0.788s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fb5c742e-22e2-4dd8-aa5e-50e2dfb150a2 tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdb25982-2901-4b50-b9c1-56722e9c0e94 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:36 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdb25982-2901-4b50-b9c1-56722e9c0e94 Jun 03 11:59:36 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:36 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5792e594-820e-4f55-973f-2c0becd53a58 1073741824" returned: 0 in 0.802s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5792e594-820e-4f55-973f-2c0becd53a58 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:36 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5792e594-820e-4f55-973f-2c0becd53a58 Jun 03 11:59:36 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fd6eebca-c5dc-4efe-bcb5-39997db8d641 tempest-VolumesActionsTest-111485632 None] Acquiring lock "cinder-5cfe99c8-8270-4eb6-909f-966dca78c22d" by "attach_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fd6eebca-c5dc-4efe-bcb5-39997db8d641 tempest-VolumesActionsTest-111485632 None] Lock "cinder-5cfe99c8-8270-4eb6-909f-966dca78c22d" acquired by "attach_volume" :: waited 0.021s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:36 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-fd6eebca-c5dc-4efe-bcb5-39997db8d641 tempest-VolumesActionsTest-111485632 None] Attaching volume 5cfe99c8-8270-4eb6-909f-966dca78c22d to instance 4485f546-5483-4cc5-9426-aa17720e916c at mountpoint /dev/vdb on host None. Jun 03 11:59:36 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-fd6eebca-c5dc-4efe-bcb5-39997db8d641 tempest-VolumesActionsTest-111485632 None] Attach volume completed successfully. Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fd6eebca-c5dc-4efe-bcb5-39997db8d641 tempest-VolumesActionsTest-111485632 None] Lock "cinder-5cfe99c8-8270-4eb6-909f-966dca78c22d" released by "attach_volume" :: held 0.121s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:36 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fb5c742e-22e2-4dd8-aa5e-50e2dfb150a2 tempest-GroupsV314Test-314243775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdb25982-2901-4b50-b9c1-56722e9c0e94" returned: 0 in 0.627s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fb5c742e-22e2-4dd8-aa5e-50e2dfb150a2 tempest-GroupsV314Test-314243775 None] Lock "cinder-quobyte-cdb25982-2901-4b50-b9c1-56722e9c0e94" released by "delete_volume" :: held 1.458s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-fb5c742e-22e2-4dd8-aa5e-50e2dfb150a2 tempest-GroupsV314Test-314243775 None] Created reservations ['2e1b5c6c-0142-4c50-80fb-d1572f3cc2e7'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:59:36 devstack cinder-volume[86724]: WARNING cinder.quota [None req-fb5c742e-22e2-4dd8-aa5e-50e2dfb150a2 tempest-GroupsV314Test-314243775 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2028434697 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2028434697, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:59:36 devstack cinder-volume[86724]: WARNING cinder.quota [None req-fb5c742e-22e2-4dd8-aa5e-50e2dfb150a2 tempest-GroupsV314Test-314243775 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2028434697 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2028434697, it is now deprecated. Please use the default quota class for default quota. Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-fb5c742e-22e2-4dd8-aa5e-50e2dfb150a2 tempest-GroupsV314Test-314243775 None] Created reservations ['cf6086c8-471f-448c-9fb9-69755d6df9c5', '38d41405-3776-4ebc-b2a4-a170cabbf940', '3432a17a-2e80-402b-8953-a7d765703c54', '3975c629-640a-4cca-9aa3-674fcfd30e08'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:59:36 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5792e594-820e-4f55-973f-2c0becd53a58" returned: 0 in 0.667s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.765s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-790152998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa01fba-3178-4947-bb82-a118d3900550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dc3fc7a0a14cf3b3a690ba4e29b37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:28Z,use_quota=True,user_id='509ecbce97fb41d6abff34dabd3b56f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Creating volume 8fa01fba-3178-4947-bb82-a118d3900550 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:59:36 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fa01fba-3178-4947-bb82-a118d3900550 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:36 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fa01fba-3178-4947-bb82-a118d3900550 1073741824 Jun 03 11:59:36 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:36 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2328bc6e-e071-409a-a892-ed15ee05527a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5792e594-820e-4f55-973f-2c0becd53a58', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:36 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a548409d-f795-4c2e-87ad-e857ca5ade4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:36 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Volume volume-5792e594-820e-4f55-973f-2c0becd53a58 (5792e594-820e-4f55-973f-2c0becd53a58): created successfully Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a548409d-f795-4c2e-87ad-e857ca5ade4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Flow 'volume_create_manager' (8983da73-93a8-4dc8-a714-02b7856c528f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:36 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-da76fea5-7541-47e3-beba-9e99270f2ceb tempest-VolumesListTestJSON-312927152 None] Created volume successfully. Jun 03 11:59:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fb5c742e-22e2-4dd8-aa5e-50e2dfb150a2 tempest-GroupsV314Test-314243775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fb5c742e-22e2-4dd8-aa5e-50e2dfb150a2 tempest-GroupsV314Test-314243775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fb5c742e-22e2-4dd8-aa5e-50e2dfb150a2 tempest-GroupsV314Test-314243775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fb5c742e-22e2-4dd8-aa5e-50e2dfb150a2 tempest-GroupsV314Test-314243775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fb5c742e-22e2-4dd8-aa5e-50e2dfb150a2 tempest-GroupsV314Test-314243775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fb5c742e-22e2-4dd8-aa5e-50e2dfb150a2 tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:37 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:59:37 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:37 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-e9042ca9-a178-4c3e-a18a-5a9884f0725d tempest-VolumesActionsTest-49794276 None] Terminate volume connection completed successfully. Jun 03 11:59:37 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.694s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:37 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:59:37 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-265959f3-eb87-4850-a04c-891ba08c77d9 tempest-GroupsV314Test-314243775 None] Acquiring lock "cinder-quobyte-f1c7de41-babf-4779-a0d0-db4b163db1f7" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:37 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fb5c742e-22e2-4dd8-aa5e-50e2dfb150a2 tempest-GroupsV314Test-314243775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.729s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:37 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-fb5c742e-22e2-4dd8-aa5e-50e2dfb150a2 tempest-GroupsV314Test-314243775 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:59:37 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-265959f3-eb87-4850-a04c-891ba08c77d9 tempest-GroupsV314Test-314243775 None] Lock "cinder-quobyte-f1c7de41-babf-4779-a0d0-db4b163db1f7" acquired by "delete_volume" :: waited 0.034s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:37 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-fb5c742e-22e2-4dd8-aa5e-50e2dfb150a2 tempest-GroupsV314Test-314243775 None] Delete group completed successfully. Jun 03 11:59:37 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fa01fba-3178-4947-bb82-a118d3900550 1073741824" returned: 0 in 1.000s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:37 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e9042ca9-a178-4c3e-a18a-5a9884f0725d tempest-VolumesActionsTest-49794276 None] Acquiring lock "cinder-5cfe99c8-8270-4eb6-909f-966dca78c22d-detach_volume" by "detach_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:37 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fce4b94-7296-419f-a37d-1c02acb23751]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-265959f3-eb87-4850-a04c-891ba08c77d9 tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:37 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e9042ca9-a178-4c3e-a18a-5a9884f0725d tempest-VolumesActionsTest-49794276 None] Lock "cinder-5cfe99c8-8270-4eb6-909f-966dca78c22d-detach_volume" acquired by "detach_volume" :: waited 0.054s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fa01fba-3178-4947-bb82-a118d3900550 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:37 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-e9042ca9-a178-4c3e-a18a-5a9884f0725d tempest-VolumesActionsTest-49794276 None] Detaching volume 5cfe99c8-8270-4eb6-909f-966dca78c22d from instance 4485f546-5483-4cc5-9426-aa17720e916c. Jun 03 11:59:37 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fa01fba-3178-4947-bb82-a118d3900550 Jun 03 11:59:37 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:37 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-e9042ca9-a178-4c3e-a18a-5a9884f0725d tempest-VolumesActionsTest-49794276 None] Detach volume completed successfully. Jun 03 11:59:37 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 Jun 03 11:59:38 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e9042ca9-a178-4c3e-a18a-5a9884f0725d tempest-VolumesActionsTest-49794276 None] Lock "cinder-5cfe99c8-8270-4eb6-909f-966dca78c22d-detach_volume" released by "detach_volume" :: held 0.099s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Flow 'volume_create_manager' (10eba0de-1b58-42de-92f3-5fef69722ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad555766-5a53-4600-8857-24ecbd0b87b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad555766-5a53-4600-8857-24ecbd0b87b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-336600575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f79c6a-8341-4993-ae39-e237f14f651f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='698bacdf5f1f4abebd1468f2ac1f71c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:38Z,use_quota=True,user_id='9006e6e5f62d4dd7826b4b603a770c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (728a66e2-784b-44f8-a1e1-3b7ebabf3b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (728a66e2-784b-44f8-a1e1-3b7ebabf3b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9532e33f-7c7d-48cb-9e5a-da0724ca4307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9532e33f-7c7d-48cb-9e5a-da0724ca4307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08f79c6a-8341-4993-ae39-e237f14f651f', 'volume_name': 'volume-08f79c6a-8341-4993-ae39-e237f14f651f', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c906993-00b5-4e88-a391-87079da7c6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c906993-00b5-4e88-a391-87079da7c6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a620a08f-ebae-49e9-b593-3130c26a17b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:38 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Volume 08f79c6a-8341-4993-ae39-e237f14f651f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08f79c6a-8341-4993-ae39-e237f14f651f', 'volume_size': 1} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a1194cbb-2178-4aeb-ae86-61e39853b834 tempest-VolumesActionsTest-111485632 None] Acquiring lock "cinder-5cfe99c8-8270-4eb6-909f-966dca78c22d-detach_volume" by "detach_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a1194cbb-2178-4aeb-ae86-61e39853b834 tempest-VolumesActionsTest-111485632 None] Lock "cinder-5cfe99c8-8270-4eb6-909f-966dca78c22d-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:38 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a1194cbb-2178-4aeb-ae86-61e39853b834 tempest-VolumesActionsTest-111485632 None] Volume detach called, but volume not attached. Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a1194cbb-2178-4aeb-ae86-61e39853b834 tempest-VolumesActionsTest-111485632 None] Lock "cinder-5cfe99c8-8270-4eb6-909f-966dca78c22d-detach_volume" released by "detach_volume" :: held 0.027s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:38 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fa01fba-3178-4947-bb82-a118d3900550" returned: 0 in 0.710s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.210s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-336600575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f79c6a-8341-4993-ae39-e237f14f651f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='698bacdf5f1f4abebd1468f2ac1f71c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:38Z,use_quota=True,user_id='9006e6e5f62d4dd7826b4b603a770c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Creating volume 08f79c6a-8341-4993-ae39-e237f14f651f {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:59:38 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-08f79c6a-8341-4993-ae39-e237f14f651f 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8322dc1a-b7df-4469-b9b9-3c6f1ba974c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fa01fba-3178-4947-bb82-a118d3900550', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:38 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-08f79c6a-8341-4993-ae39-e237f14f651f 1073741824 Jun 03 11:59:38 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed79556b-5007-41a3-8e3a-a1f7520706d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:38 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Volume volume-8fa01fba-3178-4947-bb82-a118d3900550 (8fa01fba-3178-4947-bb82-a118d3900550): created successfully Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed79556b-5007-41a3-8e3a-a1f7520706d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Flow 'volume_create_manager' (c6bca956-f7df-45ed-b4c1-bacc5c0d1b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:38 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-265959f3-eb87-4850-a04c-891ba08c77d9 tempest-GroupsV314Test-314243775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7" returned: 0 in 0.850s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-265959f3-eb87-4850-a04c-891ba08c77d9 tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:38 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-23447d5c-e65e-4c6d-a3f8-e486bdf9a377 tempest-AbsoluteLimitsTests-526845009 None] Created volume successfully. Jun 03 11:59:38 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7 Jun 03 11:59:38 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1c9b7b02-d32e-4cea-9738-3f19b79c7863 tempest-VolumesActionsTest-111485632 None] Acquiring lock "cinder-5cfe99c8-8270-4eb6-909f-966dca78c22d-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1c9b7b02-d32e-4cea-9738-3f19b79c7863 tempest-VolumesActionsTest-111485632 None] Lock "cinder-5cfe99c8-8270-4eb6-909f-966dca78c22d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1c9b7b02-d32e-4cea-9738-3f19b79c7863 tempest-VolumesActionsTest-111485632 None] Acquiring lock "cinder-quobyte-5cfe99c8-8270-4eb6-909f-966dca78c22d" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1c9b7b02-d32e-4cea-9738-3f19b79c7863 tempest-VolumesActionsTest-111485632 None] Lock "cinder-quobyte-5cfe99c8-8270-4eb6-909f-966dca78c22d" acquired by "delete_volume" :: waited 0.013s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:39 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:39 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8848896-a647-4562-845e-93ff8da07cc4]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c9b7b02-d32e-4cea-9738-3f19b79c7863 tempest-VolumesActionsTest-111485632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5cfe99c8-8270-4eb6-909f-966dca78c22d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-265959f3-eb87-4850-a04c-891ba08c77d9 tempest-GroupsV314Test-314243775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f1c7de41-babf-4779-a0d0-db4b163db1f7" returned: 0 in 0.686s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-265959f3-eb87-4850-a04c-891ba08c77d9 tempest-GroupsV314Test-314243775 None] Lock "cinder-quobyte-f1c7de41-babf-4779-a0d0-db4b163db1f7" released by "delete_volume" :: held 1.624s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:39 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-265959f3-eb87-4850-a04c-891ba08c77d9 tempest-GroupsV314Test-314243775 None] Created reservations ['2551d626-b019-4d46-a0ea-488ccdb90af2'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:59:39 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5cfe99c8-8270-4eb6-909f-966dca78c22d Jun 03 11:59:39 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:39 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-265959f3-eb87-4850-a04c-891ba08c77d9 tempest-GroupsV314Test-314243775 None] Created reservations ['eccd9927-a78d-464e-ad3a-3ce2dad38758', '2a312a93-9aa4-43e8-bb9a-9814a7fa1fba', 'b5f4636e-fd75-40f8-aa46-75b5e2a1dbdb', 'b955fbe1-1eb2-4e1f-a34a-efa2c501557f'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:59:39 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-08f79c6a-8341-4993-ae39-e237f14f651f 1073741824" returned: 0 in 0.892s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-08f79c6a-8341-4993-ae39-e237f14f651f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:39 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-08f79c6a-8341-4993-ae39-e237f14f651f Jun 03 11:59:39 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-265959f3-eb87-4850-a04c-891ba08c77d9 tempest-GroupsV314Test-314243775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-265959f3-eb87-4850-a04c-891ba08c77d9 tempest-GroupsV314Test-314243775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-265959f3-eb87-4850-a04c-891ba08c77d9 tempest-GroupsV314Test-314243775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-265959f3-eb87-4850-a04c-891ba08c77d9 tempest-GroupsV314Test-314243775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-265959f3-eb87-4850-a04c-891ba08c77d9 tempest-GroupsV314Test-314243775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-265959f3-eb87-4850-a04c-891ba08c77d9 tempest-GroupsV314Test-314243775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:39 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:59:39 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e43e94f4-2e16-407a-b87c-7ed918c66d52 tempest-AbsoluteLimitsTests-526845009 None] Acquiring lock "cinder-8fa01fba-3178-4947-bb82-a118d3900550-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e43e94f4-2e16-407a-b87c-7ed918c66d52 tempest-AbsoluteLimitsTests-526845009 None] Lock "cinder-8fa01fba-3178-4947-bb82-a118d3900550-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:40 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e43e94f4-2e16-407a-b87c-7ed918c66d52 tempest-AbsoluteLimitsTests-526845009 None] Acquiring lock "cinder-quobyte-8fa01fba-3178-4947-bb82-a118d3900550" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:40 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e43e94f4-2e16-407a-b87c-7ed918c66d52 tempest-AbsoluteLimitsTests-526845009 None] Lock "cinder-quobyte-8fa01fba-3178-4947-bb82-a118d3900550" acquired by "delete_volume" :: waited 0.032s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:40 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[945e45fc-f9b1-4c45-b2b1-289f1b9a6693]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e43e94f4-2e16-407a-b87c-7ed918c66d52 tempest-AbsoluteLimitsTests-526845009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fa01fba-3178-4947-bb82-a118d3900550 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:40 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:40 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fa01fba-3178-4947-bb82-a118d3900550 Jun 03 11:59:40 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c9b7b02-d32e-4cea-9738-3f19b79c7863 tempest-VolumesActionsTest-111485632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5cfe99c8-8270-4eb6-909f-966dca78c22d" returned: 0 in 0.897s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c9b7b02-d32e-4cea-9738-3f19b79c7863 tempest-VolumesActionsTest-111485632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5cfe99c8-8270-4eb6-909f-966dca78c22d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:40 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5cfe99c8-8270-4eb6-909f-966dca78c22d Jun 03 11:59:40 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:40 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-265959f3-eb87-4850-a04c-891ba08c77d9 tempest-GroupsV314Test-314243775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.728s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:40 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-265959f3-eb87-4850-a04c-891ba08c77d9 tempest-GroupsV314Test-314243775 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:59:40 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-265959f3-eb87-4850-a04c-891ba08c77d9 tempest-GroupsV314Test-314243775 None] Delete group completed successfully. Jun 03 11:59:40 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-08f79c6a-8341-4993-ae39-e237f14f651f" returned: 0 in 0.978s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:59:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a620a08f-ebae-49e9-b593-3130c26a17b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08f79c6a-8341-4993-ae39-e237f14f651f', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13a2bc3-4e53-41b4-8b0f-fa7eaed998cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:40 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Volume volume-08f79c6a-8341-4993-ae39-e237f14f651f (08f79c6a-8341-4993-ae39-e237f14f651f): created successfully Jun 03 11:59:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13a2bc3-4e53-41b4-8b0f-fa7eaed998cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Flow 'volume_create_manager' (10eba0de-1b58-42de-92f3-5fef69722ea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:40 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-bfdf553b-66b4-41df-856f-59b9e1cb589c tempest-VolumesListTestJSON-312927152 None] Created volume successfully. Jun 03 11:59:41 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e43e94f4-2e16-407a-b87c-7ed918c66d52 tempest-AbsoluteLimitsTests-526845009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fa01fba-3178-4947-bb82-a118d3900550" returned: 0 in 0.933s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e43e94f4-2e16-407a-b87c-7ed918c66d52 tempest-AbsoluteLimitsTests-526845009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fa01fba-3178-4947-bb82-a118d3900550 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:41 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c9b7b02-d32e-4cea-9738-3f19b79c7863 tempest-VolumesActionsTest-111485632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5cfe99c8-8270-4eb6-909f-966dca78c22d" returned: 0 in 0.766s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1c9b7b02-d32e-4cea-9738-3f19b79c7863 tempest-VolumesActionsTest-111485632 None] Lock "cinder-quobyte-5cfe99c8-8270-4eb6-909f-966dca78c22d" released by "delete_volume" :: held 1.716s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:41 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fa01fba-3178-4947-bb82-a118d3900550 Jun 03 11:59:41 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:41 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-1c9b7b02-d32e-4cea-9738-3f19b79c7863 tempest-VolumesActionsTest-111485632 None] Created reservations ['698044fe-98da-42cb-9ba8-51514f542c21', 'b2022ff9-db18-4eb0-b532-df868eb22ed6', '5da876be-011f-431e-9742-6ec389d80703', 'b7567ae6-12c9-4164-94fb-816a184f3d7c'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:59:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1c9b7b02-d32e-4cea-9738-3f19b79c7863 tempest-VolumesActionsTest-111485632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1c9b7b02-d32e-4cea-9738-3f19b79c7863 tempest-VolumesActionsTest-111485632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:41 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1c9b7b02-d32e-4cea-9738-3f19b79c7863 tempest-VolumesActionsTest-111485632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:41 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1c9b7b02-d32e-4cea-9738-3f19b79c7863 tempest-VolumesActionsTest-111485632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1c9b7b02-d32e-4cea-9738-3f19b79c7863 tempest-VolumesActionsTest-111485632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c9b7b02-d32e-4cea-9738-3f19b79c7863 tempest-VolumesActionsTest-111485632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:41 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:59:41 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:41 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e43e94f4-2e16-407a-b87c-7ed918c66d52 tempest-AbsoluteLimitsTests-526845009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fa01fba-3178-4947-bb82-a118d3900550" returned: 0 in 0.886s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e43e94f4-2e16-407a-b87c-7ed918c66d52 tempest-AbsoluteLimitsTests-526845009 None] Lock "cinder-quobyte-8fa01fba-3178-4947-bb82-a118d3900550" released by "delete_volume" :: held 1.899s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-e43e94f4-2e16-407a-b87c-7ed918c66d52 tempest-AbsoluteLimitsTests-526845009 None] Created reservations ['e7153274-d8c3-4241-a9d0-1b773957faab', '8023280c-04a2-4717-8d4c-92066334a166', '774a26f5-00a4-4e75-b80e-ef18a8720282', 'f274548f-26f2-43d3-888d-b6c4ce584583'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:59:42 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c9b7b02-d32e-4cea-9738-3f19b79c7863 tempest-VolumesActionsTest-111485632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.896s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-1c9b7b02-d32e-4cea-9738-3f19b79c7863 tempest-VolumesActionsTest-111485632 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:59:42 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-1c9b7b02-d32e-4cea-9738-3f19b79c7863 tempest-VolumesActionsTest-111485632 None] Deleted volume successfully. Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1c9b7b02-d32e-4cea-9738-3f19b79c7863 tempest-VolumesActionsTest-111485632 None] Lock "cinder-5cfe99c8-8270-4eb6-909f-966dca78c22d-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e43e94f4-2e16-407a-b87c-7ed918c66d52 tempest-AbsoluteLimitsTests-526845009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e43e94f4-2e16-407a-b87c-7ed918c66d52 tempest-AbsoluteLimitsTests-526845009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e43e94f4-2e16-407a-b87c-7ed918c66d52 tempest-AbsoluteLimitsTests-526845009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e43e94f4-2e16-407a-b87c-7ed918c66d52 tempest-AbsoluteLimitsTests-526845009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e43e94f4-2e16-407a-b87c-7ed918c66d52 tempest-AbsoluteLimitsTests-526845009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e43e94f4-2e16-407a-b87c-7ed918c66d52 tempest-AbsoluteLimitsTests-526845009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:42 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:59:42 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Flow 'volume_create_manager' (f029ca24-e59d-4477-b1c2-a38745d6b94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae11894-897b-4f65-b466-99dea599bdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae11894-897b-4f65-b466-99dea599bdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1477380557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='698bacdf5f1f4abebd1468f2ac1f71c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:42Z,use_quota=True,user_id='9006e6e5f62d4dd7826b4b603a770c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a531f27e-0bdc-412c-8eb6-52c28aae8522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a531f27e-0bdc-412c-8eb6-52c28aae8522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3f481b-1813-4172-8232-38eec6936ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3f481b-1813-4172-8232-38eec6936ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a', 'volume_name': 'volume-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3f9b2f-4b50-4e7e-97cf-381b8bc5462e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3f9b2f-4b50-4e7e-97cf-381b8bc5462e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f18b09b-0946-4b9a-86c3-fe6f6c11f12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:42 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Volume cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a', 'volume_size': 1} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1477380557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='698bacdf5f1f4abebd1468f2ac1f71c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:42Z,use_quota=True,user_id='9006e6e5f62d4dd7826b4b603a770c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Creating volume cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:59:42 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:59:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:42 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a 1073741824 Jun 03 11:59:42 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:43 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e43e94f4-2e16-407a-b87c-7ed918c66d52 tempest-AbsoluteLimitsTests-526845009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.941s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:43 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-e43e94f4-2e16-407a-b87c-7ed918c66d52 tempest-AbsoluteLimitsTests-526845009 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:59:43 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-e43e94f4-2e16-407a-b87c-7ed918c66d52 tempest-AbsoluteLimitsTests-526845009 None] Deleted volume successfully. Jun 03 11:59:43 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e43e94f4-2e16-407a-b87c-7ed918c66d52 tempest-AbsoluteLimitsTests-526845009 None] Lock "cinder-8fa01fba-3178-4947-bb82-a118d3900550-delete_volume" released by "delete_volume" :: held 3.254s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:43 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a 1073741824" returned: 0 in 1.266s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:43 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a Jun 03 11:59:43 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:44 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a" returned: 0 in 0.816s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:44 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] <== create_volume: return (2157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:59:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.161s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:44 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f18b09b-0946-4b9a-86c3-fe6f6c11f12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:44 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b32142-4cd4-41ef-adb9-1f8e511ebae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:44 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Volume volume-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a (cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a): created successfully Jun 03 11:59:44 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b32142-4cd4-41ef-adb9-1f8e511ebae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:44 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Flow 'volume_create_manager' (f029ca24-e59d-4477-b1c2-a38745d6b94d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:44 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-896e208d-c325-4dc6-acd5-44bea091fd9e tempest-VolumesListTestJSON-312927152 None] Created volume successfully. Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Flow 'volume_create_manager' (5ea2dc25-77ab-4a3f-832e-d6e174380541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e4faab-7433-4deb-bb04-932503bcc9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e4faab-7433-4deb-bb04-932503bcc9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1012953140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f47bfa-2071-4d0e-acad-ac1c6e00f3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db33302489dd4a129e2e3e458da66b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:48Z,use_quota=True,user_id='585b143aaeff4f19ba2fba8048dc8f6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9decd2a8-baca-403b-b54d-8e03d8d679df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9decd2a8-baca-403b-b54d-8e03d8d679df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc755da3-3883-489b-b63e-747cc03e7347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc755da3-3883-489b-b63e-747cc03e7347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52f47bfa-2071-4d0e-acad-ac1c6e00f3fe', 'volume_name': 'volume-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0bd1df0-7805-4e52-a76f-b83417f5c7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0bd1df0-7805-4e52-a76f-b83417f5c7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4712298c-2aa1-4961-8acd-693fae866803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:47 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Volume 52f47bfa-2071-4d0e-acad-ac1c6e00f3fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe', 'volume_size': 1} Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1012953140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f47bfa-2071-4d0e-acad-ac1c6e00f3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db33302489dd4a129e2e3e458da66b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:48Z,use_quota=True,user_id='585b143aaeff4f19ba2fba8048dc8f6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Creating volume 52f47bfa-2071-4d0e-acad-ac1c6e00f3fe {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:59:47 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:59:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:48 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe 1073741824 Jun 03 11:59:48 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a3ae6dfe-f668-48ea-be60-0967cf0c3df2 tempest-VolumesListTestJSON-312927152 None] Acquiring lock "cinder-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a3ae6dfe-f668-48ea-be60-0967cf0c3df2 tempest-VolumesListTestJSON-312927152 None] Lock "cinder-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a3ae6dfe-f668-48ea-be60-0967cf0c3df2 tempest-VolumesListTestJSON-312927152 None] Acquiring lock "cinder-quobyte-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a3ae6dfe-f668-48ea-be60-0967cf0c3df2 tempest-VolumesListTestJSON-312927152 None] Lock "cinder-quobyte-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a" acquired by "delete_volume" :: waited 0.025s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:48 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca80dd3c-5e3b-4ec3-aa4c-0d5f493749a8]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a3ae6dfe-f668-48ea-be60-0967cf0c3df2 tempest-VolumesListTestJSON-312927152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:48 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a Jun 03 11:59:48 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:49 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe 1073741824" returned: 0 in 1.117s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Flow 'volume_create_manager' (9168a7d3-16c5-4028-89a5-c946935d4e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42a9a88-7e78-4616-9881-d777eb318cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42a9a88-7e78-4616-9881-d777eb318cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1937694333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e12d1f51-8688-42b4-8732-9abe195eb46f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a8c6c009d1483da8aa7c9619c8349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:49Z,use_quota=True,user_id='ddf3d9669a524f89aaac8b4024a16d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f16cbdc-74cd-42c0-b2f8-7ae559daf4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f16cbdc-74cd-42c0-b2f8-7ae559daf4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ad86ef-a40f-4347-877d-eff7532966cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ad86ef-a40f-4347-877d-eff7532966cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e12d1f51-8688-42b4-8732-9abe195eb46f', 'volume_name': 'volume-e12d1f51-8688-42b4-8732-9abe195eb46f', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf682da-6eba-4c82-9f3d-9d96c89a30ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf682da-6eba-4c82-9f3d-9d96c89a30ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0c142f-f50e-42d0-b4f9-28be41873e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:49 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Volume e12d1f51-8688-42b4-8732-9abe195eb46f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e12d1f51-8688-42b4-8732-9abe195eb46f', 'volume_size': 1} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:49 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe Jun 03 11:59:49 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:49 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a3ae6dfe-f668-48ea-be60-0967cf0c3df2 tempest-VolumesListTestJSON-312927152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a" returned: 0 in 1.032s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a3ae6dfe-f668-48ea-be60-0967cf0c3df2 tempest-VolumesListTestJSON-312927152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:49 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a Jun 03 11:59:49 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:49 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe" returned: 0 in 0.684s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.704s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1937694333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e12d1f51-8688-42b4-8732-9abe195eb46f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a8c6c009d1483da8aa7c9619c8349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:49Z,use_quota=True,user_id='ddf3d9669a524f89aaac8b4024a16d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Creating volume e12d1f51-8688-42b4-8732-9abe195eb46f {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:59:49 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e12d1f51-8688-42b4-8732-9abe195eb46f 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4712298c-2aa1-4961-8acd-693fae866803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9796d2d7-3584-4ab7-abb2-9b1adf936599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:49 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e12d1f51-8688-42b4-8732-9abe195eb46f 1073741824 Jun 03 11:59:49 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:50 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Volume volume-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe (52f47bfa-2071-4d0e-acad-ac1c6e00f3fe): created successfully Jun 03 11:59:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9796d2d7-3584-4ab7-abb2-9b1adf936599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Flow 'volume_create_manager' (5ea2dc25-77ab-4a3f-832e-d6e174380541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:50 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d06030ec-1cdb-4954-b4f1-6937652eb88f tempest-VolumesMetadataTest-118185602 None] Created volume successfully. Jun 03 11:59:50 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a3ae6dfe-f668-48ea-be60-0967cf0c3df2 tempest-VolumesListTestJSON-312927152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a" returned: 0 in 0.715s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a3ae6dfe-f668-48ea-be60-0967cf0c3df2 tempest-VolumesListTestJSON-312927152 None] Lock "cinder-quobyte-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a" released by "delete_volume" :: held 1.807s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:50 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-a3ae6dfe-f668-48ea-be60-0967cf0c3df2 tempest-VolumesListTestJSON-312927152 None] Created reservations ['eeb7d4fd-16bd-4f6f-8f37-e2da739ed824', '623fe39a-f498-40d6-a73e-ddaa526aae01', '4227bfa4-50f7-43c6-8d31-ef93b1af0392', '38f3f69a-199b-45fe-b670-73ca9bf937f5'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:59:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a3ae6dfe-f668-48ea-be60-0967cf0c3df2 tempest-VolumesListTestJSON-312927152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a3ae6dfe-f668-48ea-be60-0967cf0c3df2 tempest-VolumesListTestJSON-312927152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:50 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a3ae6dfe-f668-48ea-be60-0967cf0c3df2 tempest-VolumesListTestJSON-312927152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:50 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a3ae6dfe-f668-48ea-be60-0967cf0c3df2 tempest-VolumesListTestJSON-312927152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a3ae6dfe-f668-48ea-be60-0967cf0c3df2 tempest-VolumesListTestJSON-312927152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a3ae6dfe-f668-48ea-be60-0967cf0c3df2 tempest-VolumesListTestJSON-312927152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:50 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:59:50 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0f112623-38fa-469e-8585-f25026214367 tempest-VolumesListTestJSON-312927152 None] Acquiring lock "cinder-08f79c6a-8341-4993-ae39-e237f14f651f-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0f112623-38fa-469e-8585-f25026214367 tempest-VolumesListTestJSON-312927152 None] Lock "cinder-08f79c6a-8341-4993-ae39-e237f14f651f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0f112623-38fa-469e-8585-f25026214367 tempest-VolumesListTestJSON-312927152 None] Acquiring lock "cinder-quobyte-08f79c6a-8341-4993-ae39-e237f14f651f" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0f112623-38fa-469e-8585-f25026214367 tempest-VolumesListTestJSON-312927152 None] Lock "cinder-quobyte-08f79c6a-8341-4993-ae39-e237f14f651f" acquired by "delete_volume" :: waited 0.029s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:50 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ece1fa-7663-4a5b-ba9d-be3dbee0edf3]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0f112623-38fa-469e-8585-f25026214367 tempest-VolumesListTestJSON-312927152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-08f79c6a-8341-4993-ae39-e237f14f651f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:50 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-08f79c6a-8341-4993-ae39-e237f14f651f Jun 03 11:59:50 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:50 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e12d1f51-8688-42b4-8732-9abe195eb46f 1073741824" returned: 0 in 1.004s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e12d1f51-8688-42b4-8732-9abe195eb46f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:51 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e12d1f51-8688-42b4-8732-9abe195eb46f Jun 03 11:59:51 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:51 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a3ae6dfe-f668-48ea-be60-0967cf0c3df2 tempest-VolumesListTestJSON-312927152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.819s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:51 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-a3ae6dfe-f668-48ea-be60-0967cf0c3df2 tempest-VolumesListTestJSON-312927152 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:59:51 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a3ae6dfe-f668-48ea-be60-0967cf0c3df2 tempest-VolumesListTestJSON-312927152 None] Deleted volume successfully. Jun 03 11:59:51 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a3ae6dfe-f668-48ea-be60-0967cf0c3df2 tempest-VolumesListTestJSON-312927152 None] Lock "cinder-cdc1cc5d-08c9-4f30-a6eb-ba9c3d17705a-delete_volume" released by "delete_volume" :: held 2.903s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:51 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0f112623-38fa-469e-8585-f25026214367 tempest-VolumesListTestJSON-312927152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-08f79c6a-8341-4993-ae39-e237f14f651f" returned: 0 in 0.963s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0f112623-38fa-469e-8585-f25026214367 tempest-VolumesListTestJSON-312927152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-08f79c6a-8341-4993-ae39-e237f14f651f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:51 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-08f79c6a-8341-4993-ae39-e237f14f651f Jun 03 11:59:51 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:51 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e12d1f51-8688-42b4-8732-9abe195eb46f" returned: 0 in 0.828s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:59:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0c142f-f50e-42d0-b4f9-28be41873e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e12d1f51-8688-42b4-8732-9abe195eb46f', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a9ba37-0a92-4c8b-8d1c-f06b68bbf5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:51 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Volume volume-e12d1f51-8688-42b4-8732-9abe195eb46f (e12d1f51-8688-42b4-8732-9abe195eb46f): created successfully Jun 03 11:59:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a9ba37-0a92-4c8b-8d1c-f06b68bbf5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Flow 'volume_create_manager' (9168a7d3-16c5-4028-89a5-c946935d4e47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:51 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-bd17bd4f-bfa5-4433-84f1-095b3bc3f363 tempest-VolumesActionsTest-111485632 None] Created volume successfully. Jun 03 11:59:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-75292a81-26d0-4486-88bb-e42322b65a08 tempest-VolumesMetadataTest-118185602 None] Acquiring lock "cinder-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-75292a81-26d0-4486-88bb-e42322b65a08 tempest-VolumesMetadataTest-118185602 None] Lock "cinder-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-75292a81-26d0-4486-88bb-e42322b65a08 tempest-VolumesMetadataTest-118185602 None] Acquiring lock "cinder-quobyte-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-75292a81-26d0-4486-88bb-e42322b65a08 tempest-VolumesMetadataTest-118185602 None] Lock "cinder-quobyte-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe" acquired by "delete_volume" :: waited 0.018s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:52 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb35ef8f-0aeb-4bc1-a84c-1ebeea2efa39]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-75292a81-26d0-4486-88bb-e42322b65a08 tempest-VolumesMetadataTest-118185602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:52 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe Jun 03 11:59:52 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:52 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7aaf60ee-13df-4559-8141-5fbdd5b45f15 tempest-VolumesActionsTest-49794276 None] Acquiring lock "cinder-e12d1f51-8688-42b4-8732-9abe195eb46f-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0f112623-38fa-469e-8585-f25026214367 tempest-VolumesListTestJSON-312927152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-08f79c6a-8341-4993-ae39-e237f14f651f" returned: 0 in 0.824s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7aaf60ee-13df-4559-8141-5fbdd5b45f15 tempest-VolumesActionsTest-49794276 None] Lock "cinder-e12d1f51-8688-42b4-8732-9abe195eb46f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0f112623-38fa-469e-8585-f25026214367 tempest-VolumesListTestJSON-312927152 None] Lock "cinder-quobyte-08f79c6a-8341-4993-ae39-e237f14f651f" released by "delete_volume" :: held 1.867s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7aaf60ee-13df-4559-8141-5fbdd5b45f15 tempest-VolumesActionsTest-49794276 None] Acquiring lock "cinder-quobyte-e12d1f51-8688-42b4-8732-9abe195eb46f" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:52 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-0f112623-38fa-469e-8585-f25026214367 tempest-VolumesListTestJSON-312927152 None] Created reservations ['19a5546c-0459-4564-b202-52e2fcc92af4', 'effecc87-7278-47db-a83f-f0ef7ffe39b4', 'b2f2ba2a-0f47-435c-ad23-90eab963b265', '9391ba1d-84e8-447d-a554-cc6caa1365b0'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:59:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7aaf60ee-13df-4559-8141-5fbdd5b45f15 tempest-VolumesActionsTest-49794276 None] Lock "cinder-quobyte-e12d1f51-8688-42b4-8732-9abe195eb46f" acquired by "delete_volume" :: waited 0.029s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:52 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d53b81-2f8c-40ed-82e5-4b01ad670796]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7aaf60ee-13df-4559-8141-5fbdd5b45f15 tempest-VolumesActionsTest-49794276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e12d1f51-8688-42b4-8732-9abe195eb46f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0f112623-38fa-469e-8585-f25026214367 tempest-VolumesListTestJSON-312927152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0f112623-38fa-469e-8585-f25026214367 tempest-VolumesListTestJSON-312927152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0f112623-38fa-469e-8585-f25026214367 tempest-VolumesListTestJSON-312927152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0f112623-38fa-469e-8585-f25026214367 tempest-VolumesListTestJSON-312927152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0f112623-38fa-469e-8585-f25026214367 tempest-VolumesListTestJSON-312927152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0f112623-38fa-469e-8585-f25026214367 tempest-VolumesListTestJSON-312927152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:52 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:59:52 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:52 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e12d1f51-8688-42b4-8732-9abe195eb46f Jun 03 11:59:52 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:53 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5131f575-9a6c-4808-87ea-ebda2a762b14 tempest-VolumesListTestJSON-312927152 None] Acquiring lock "cinder-5792e594-820e-4f55-973f-2c0becd53a58-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:53 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5131f575-9a6c-4808-87ea-ebda2a762b14 tempest-VolumesListTestJSON-312927152 None] Lock "cinder-5792e594-820e-4f55-973f-2c0becd53a58-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:53 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5131f575-9a6c-4808-87ea-ebda2a762b14 tempest-VolumesListTestJSON-312927152 None] Acquiring lock "cinder-quobyte-5792e594-820e-4f55-973f-2c0becd53a58" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 11:59:53 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5131f575-9a6c-4808-87ea-ebda2a762b14 tempest-VolumesListTestJSON-312927152 None] Lock "cinder-quobyte-5792e594-820e-4f55-973f-2c0becd53a58" acquired by "delete_volume" :: waited 0.028s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 11:59:53 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[46808d0e-931a-4f6d-a211-e8f9037e3e3c]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 11:59:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5131f575-9a6c-4808-87ea-ebda2a762b14 tempest-VolumesListTestJSON-312927152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5792e594-820e-4f55-973f-2c0becd53a58 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:53 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5792e594-820e-4f55-973f-2c0becd53a58 Jun 03 11:59:53 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:53 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-75292a81-26d0-4486-88bb-e42322b65a08 tempest-VolumesMetadataTest-118185602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe" returned: 0 in 1.231s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-75292a81-26d0-4486-88bb-e42322b65a08 tempest-VolumesMetadataTest-118185602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:53 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe Jun 03 11:59:53 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:53 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0f112623-38fa-469e-8585-f25026214367 tempest-VolumesListTestJSON-312927152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.984s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:53 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-0f112623-38fa-469e-8585-f25026214367 tempest-VolumesListTestJSON-312927152 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:59:53 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-0f112623-38fa-469e-8585-f25026214367 tempest-VolumesListTestJSON-312927152 None] Deleted volume successfully. Jun 03 11:59:53 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0f112623-38fa-469e-8585-f25026214367 tempest-VolumesListTestJSON-312927152 None] Lock "cinder-08f79c6a-8341-4993-ae39-e237f14f651f-delete_volume" released by "delete_volume" :: held 3.210s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:53 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7aaf60ee-13df-4559-8141-5fbdd5b45f15 tempest-VolumesActionsTest-49794276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e12d1f51-8688-42b4-8732-9abe195eb46f" returned: 0 in 1.170s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7aaf60ee-13df-4559-8141-5fbdd5b45f15 tempest-VolumesActionsTest-49794276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e12d1f51-8688-42b4-8732-9abe195eb46f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:53 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e12d1f51-8688-42b4-8732-9abe195eb46f Jun 03 11:59:53 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:54 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5131f575-9a6c-4808-87ea-ebda2a762b14 tempest-VolumesListTestJSON-312927152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5792e594-820e-4f55-973f-2c0becd53a58" returned: 0 in 0.985s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5131f575-9a6c-4808-87ea-ebda2a762b14 tempest-VolumesListTestJSON-312927152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5792e594-820e-4f55-973f-2c0becd53a58 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:54 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5792e594-820e-4f55-973f-2c0becd53a58 Jun 03 11:59:54 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:54 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-75292a81-26d0-4486-88bb-e42322b65a08 tempest-VolumesMetadataTest-118185602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe" returned: 0 in 0.745s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-75292a81-26d0-4486-88bb-e42322b65a08 tempest-VolumesMetadataTest-118185602 None] Lock "cinder-quobyte-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe" released by "delete_volume" :: held 2.060s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:54 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-75292a81-26d0-4486-88bb-e42322b65a08 tempest-VolumesMetadataTest-118185602 None] Created reservations ['244c0579-db27-4fd8-ad02-4cfc1d8f9606', '0f481a95-2321-4609-bfb8-64cc6e118b6f', 'a4d69b6a-28d9-41de-8317-d4a9a7f0f934', '182f9119-77d0-4b3a-9396-bed2210e3b35'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:59:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-75292a81-26d0-4486-88bb-e42322b65a08 tempest-VolumesMetadataTest-118185602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-75292a81-26d0-4486-88bb-e42322b65a08 tempest-VolumesMetadataTest-118185602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:54 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-75292a81-26d0-4486-88bb-e42322b65a08 tempest-VolumesMetadataTest-118185602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:54 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-75292a81-26d0-4486-88bb-e42322b65a08 tempest-VolumesMetadataTest-118185602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-75292a81-26d0-4486-88bb-e42322b65a08 tempest-VolumesMetadataTest-118185602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-75292a81-26d0-4486-88bb-e42322b65a08 tempest-VolumesMetadataTest-118185602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:54 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:59:54 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:54 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7aaf60ee-13df-4559-8141-5fbdd5b45f15 tempest-VolumesActionsTest-49794276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e12d1f51-8688-42b4-8732-9abe195eb46f" returned: 0 in 0.809s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7aaf60ee-13df-4559-8141-5fbdd5b45f15 tempest-VolumesActionsTest-49794276 None] Lock "cinder-quobyte-e12d1f51-8688-42b4-8732-9abe195eb46f" released by "delete_volume" :: held 2.062s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:54 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-7aaf60ee-13df-4559-8141-5fbdd5b45f15 tempest-VolumesActionsTest-49794276 None] Created reservations ['fb1460bf-12c6-4e06-bfbd-9bc261e6bfb1', '4db6d5da-90a7-4d6e-abb0-b87794b683c6', 'd821f287-2ea3-4be8-93af-f59b201dd8a2', 'd3050691-b064-45d3-b8c4-3c78fea0d12f'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:59:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7aaf60ee-13df-4559-8141-5fbdd5b45f15 tempest-VolumesActionsTest-49794276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7aaf60ee-13df-4559-8141-5fbdd5b45f15 tempest-VolumesActionsTest-49794276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:54 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7aaf60ee-13df-4559-8141-5fbdd5b45f15 tempest-VolumesActionsTest-49794276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:54 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7aaf60ee-13df-4559-8141-5fbdd5b45f15 tempest-VolumesActionsTest-49794276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7aaf60ee-13df-4559-8141-5fbdd5b45f15 tempest-VolumesActionsTest-49794276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7aaf60ee-13df-4559-8141-5fbdd5b45f15 tempest-VolumesActionsTest-49794276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:54 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:59:54 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:55 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5131f575-9a6c-4808-87ea-ebda2a762b14 tempest-VolumesListTestJSON-312927152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5792e594-820e-4f55-973f-2c0becd53a58" returned: 0 in 0.878s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:55 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5131f575-9a6c-4808-87ea-ebda2a762b14 tempest-VolumesListTestJSON-312927152 None] Lock "cinder-quobyte-5792e594-820e-4f55-973f-2c0becd53a58" released by "delete_volume" :: held 1.934s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:55 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-5131f575-9a6c-4808-87ea-ebda2a762b14 tempest-VolumesListTestJSON-312927152 None] Created reservations ['b931c94f-45cd-455e-ab91-3da24a3f2899', '706a08d3-d0c0-473b-aec7-7eb7a592c195', '7a521aeb-8087-4ed1-88c6-4d7c5dce1e48', '4a56bf32-2b79-4dc6-b816-0cec412c3291'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 11:59:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5131f575-9a6c-4808-87ea-ebda2a762b14 tempest-VolumesListTestJSON-312927152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5131f575-9a6c-4808-87ea-ebda2a762b14 tempest-VolumesListTestJSON-312927152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:55 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5131f575-9a6c-4808-87ea-ebda2a762b14 tempest-VolumesListTestJSON-312927152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:55 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5131f575-9a6c-4808-87ea-ebda2a762b14 tempest-VolumesListTestJSON-312927152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5131f575-9a6c-4808-87ea-ebda2a762b14 tempest-VolumesListTestJSON-312927152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5131f575-9a6c-4808-87ea-ebda2a762b14 tempest-VolumesListTestJSON-312927152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:55 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 11:59:55 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:55 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-75292a81-26d0-4486-88bb-e42322b65a08 tempest-VolumesMetadataTest-118185602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.985s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:55 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-75292a81-26d0-4486-88bb-e42322b65a08 tempest-VolumesMetadataTest-118185602 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:59:55 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-75292a81-26d0-4486-88bb-e42322b65a08 tempest-VolumesMetadataTest-118185602 None] Deleted volume successfully. Jun 03 11:59:55 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-75292a81-26d0-4486-88bb-e42322b65a08 tempest-VolumesMetadataTest-118185602 None] Lock "cinder-52f47bfa-2071-4d0e-acad-ac1c6e00f3fe-delete_volume" released by "delete_volume" :: held 3.362s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:56 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7aaf60ee-13df-4559-8141-5fbdd5b45f15 tempest-VolumesActionsTest-49794276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.079s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-7aaf60ee-13df-4559-8141-5fbdd5b45f15 tempest-VolumesActionsTest-49794276 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:59:56 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-7aaf60ee-13df-4559-8141-5fbdd5b45f15 tempest-VolumesActionsTest-49794276 None] Deleted volume successfully. Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7aaf60ee-13df-4559-8141-5fbdd5b45f15 tempest-VolumesActionsTest-49794276 None] Lock "cinder-e12d1f51-8688-42b4-8732-9abe195eb46f-delete_volume" released by "delete_volume" :: held 3.527s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:56 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5131f575-9a6c-4808-87ea-ebda2a762b14 tempest-VolumesListTestJSON-312927152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.098s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5131f575-9a6c-4808-87ea-ebda2a762b14 tempest-VolumesListTestJSON-312927152 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 11:59:56 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-5131f575-9a6c-4808-87ea-ebda2a762b14 tempest-VolumesListTestJSON-312927152 None] Deleted volume successfully. Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5131f575-9a6c-4808-87ea-ebda2a762b14 tempest-VolumesListTestJSON-312927152 None] Lock "cinder-5792e594-820e-4f55-973f-2c0becd53a58-delete_volume" released by "delete_volume" :: held 3.375s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Flow 'volume_create_manager' (74f8dc43-a1cd-43b7-abbc-512b9bec831b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be9e7281-bc44-4e68-83e8-5ef494961658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be9e7281-bc44-4e68-83e8-5ef494961658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-460480716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64dcd07d-3cb1-425b-8a02-107e3d31c9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a8c6c009d1483da8aa7c9619c8349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:56Z,use_quota=True,user_id='ddf3d9669a524f89aaac8b4024a16d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae43a86-2dcf-49f3-86ab-d36cd6bdb0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae43a86-2dcf-49f3-86ab-d36cd6bdb0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07950fb1-7950-416d-b1cb-9aaa09578da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07950fb1-7950-416d-b1cb-9aaa09578da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64dcd07d-3cb1-425b-8a02-107e3d31c9f1', 'volume_name': 'volume-64dcd07d-3cb1-425b-8a02-107e3d31c9f1', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05480cf-19ef-4455-a030-4879316c0c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05480cf-19ef-4455-a030-4879316c0c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d855dccb-25b2-430f-ac87-316dad9f59ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:56 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Volume 64dcd07d-3cb1-425b-8a02-107e3d31c9f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64dcd07d-3cb1-425b-8a02-107e3d31c9f1', 'volume_size': 1} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-460480716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64dcd07d-3cb1-425b-8a02-107e3d31c9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a8c6c009d1483da8aa7c9619c8349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T09:59:56Z,use_quota=True,user_id='ddf3d9669a524f89aaac8b4024a16d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Creating volume 64dcd07d-3cb1-425b-8a02-107e3d31c9f1 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:59:56 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:59:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64dcd07d-3cb1-425b-8a02-107e3d31c9f1 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:56 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64dcd07d-3cb1-425b-8a02-107e3d31c9f1 1073741824 Jun 03 11:59:56 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:57 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64dcd07d-3cb1-425b-8a02-107e3d31c9f1 1073741824" returned: 0 in 1.077s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64dcd07d-3cb1-425b-8a02-107e3d31c9f1 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:57 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64dcd07d-3cb1-425b-8a02-107e3d31c9f1 Jun 03 11:59:57 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 11:59:58 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Jun 03 11:59:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64dcd07d-3cb1-425b-8a02-107e3d31c9f1" returned: 0 in 0.749s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 11:59:58 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 11:59:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:58 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d855dccb-25b2-430f-ac87-316dad9f59ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64dcd07d-3cb1-425b-8a02-107e3d31c9f1', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:58 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92f4b25-2f1a-4ede-91af-f98851cb3945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:58 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Volume volume-64dcd07d-3cb1-425b-8a02-107e3d31c9f1 (64dcd07d-3cb1-425b-8a02-107e3d31c9f1): created successfully Jun 03 11:59:58 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92f4b25-2f1a-4ede-91af-f98851cb3945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:58 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Flow 'volume_create_manager' (74f8dc43-a1cd-43b7-abbc-512b9bec831b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:58 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-fecf6e58-a9d4-480e-bbed-34afb8726687 tempest-VolumesActionsTest-111485632 None] Created volume successfully. Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Flow 'volume_create_manager' (3a0b51bb-703c-4f77-a6dc-bc6606088b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7a5cb5-a53e-412d-b4c2-f5249162a40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7a5cb5-a53e-412d-b4c2-f5249162a40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1236866927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7819317-75eb-4f84-9f43-01ace5d6c18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517bcebc4a494343b9fe8007899597c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:00Z,use_quota=True,user_id='73ebffc0da66460cb91f826a96dd4af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5ab56d-bc73-47ef-9e38-e0ad1c39f728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5ab56d-bc73-47ef-9e38-e0ad1c39f728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e3b7fb-f307-463b-a9da-b0d67e5cb017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e3b7fb-f307-463b-a9da-b0d67e5cb017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7819317-75eb-4f84-9f43-01ace5d6c18c', 'volume_name': 'volume-b7819317-75eb-4f84-9f43-01ace5d6c18c', 'volume_size': 2}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812d7af6-bd0b-4213-896d-28f9222df180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812d7af6-bd0b-4213-896d-28f9222df180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d28656-db7b-4d4e-a4f8-4e61c1629324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 11:59:59 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Volume b7819317-75eb-4f84-9f43-01ace5d6c18c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7819317-75eb-4f84-9f43-01ace5d6c18c', 'volume_size': 2} Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T09:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1236866927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7819317-75eb-4f84-9f43-01ace5d6c18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517bcebc4a494343b9fe8007899597c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T09:59:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:00Z,use_quota=True,user_id='73ebffc0da66460cb91f826a96dd4af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Creating volume b7819317-75eb-4f84-9f43-01ace5d6c18c {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 11:59:59 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 11:59:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7819317-75eb-4f84-9f43-01ace5d6c18c 2147483648 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 11:59:59 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7819317-75eb-4f84-9f43-01ace5d6c18c 2147483648 Jun 03 11:59:59 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-744c6284-e6f6-4fbf-a96f-f9b4ab2d1c64 tempest-VolumesActionsTest-49794276 None] Acquiring lock "cinder-64dcd07d-3cb1-425b-8a02-107e3d31c9f1-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:00:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-744c6284-e6f6-4fbf-a96f-f9b4ab2d1c64 tempest-VolumesActionsTest-49794276 None] Lock "cinder-64dcd07d-3cb1-425b-8a02-107e3d31c9f1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:00:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-744c6284-e6f6-4fbf-a96f-f9b4ab2d1c64 tempest-VolumesActionsTest-49794276 None] Acquiring lock "cinder-quobyte-64dcd07d-3cb1-425b-8a02-107e3d31c9f1" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:00:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-744c6284-e6f6-4fbf-a96f-f9b4ab2d1c64 tempest-VolumesActionsTest-49794276 None] Lock "cinder-quobyte-64dcd07d-3cb1-425b-8a02-107e3d31c9f1" acquired by "delete_volume" :: waited 0.018s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:00:00 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b03597-6d3b-4f22-a22f-a67f96e308f2]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:00:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-744c6284-e6f6-4fbf-a96f-f9b4ab2d1c64 tempest-VolumesActionsTest-49794276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64dcd07d-3cb1-425b-8a02-107e3d31c9f1 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:00 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64dcd07d-3cb1-425b-8a02-107e3d31c9f1 Jun 03 12:00:00 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:01 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7819317-75eb-4f84-9f43-01ace5d6c18c 2147483648" returned: 0 in 1.401s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:01 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-744c6284-e6f6-4fbf-a96f-f9b4ab2d1c64 tempest-VolumesActionsTest-49794276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64dcd07d-3cb1-425b-8a02-107e3d31c9f1" returned: 0 in 0.908s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-744c6284-e6f6-4fbf-a96f-f9b4ab2d1c64 tempest-VolumesActionsTest-49794276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64dcd07d-3cb1-425b-8a02-107e3d31c9f1 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7819317-75eb-4f84-9f43-01ace5d6c18c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:01 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64dcd07d-3cb1-425b-8a02-107e3d31c9f1 Jun 03 12:00:01 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:01 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7819317-75eb-4f84-9f43-01ace5d6c18c Jun 03 12:00:01 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:01 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-744c6284-e6f6-4fbf-a96f-f9b4ab2d1c64 tempest-VolumesActionsTest-49794276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64dcd07d-3cb1-425b-8a02-107e3d31c9f1" returned: 0 in 0.776s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:01 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-744c6284-e6f6-4fbf-a96f-f9b4ab2d1c64 tempest-VolumesActionsTest-49794276 None] Lock "cinder-quobyte-64dcd07d-3cb1-425b-8a02-107e3d31c9f1" released by "delete_volume" :: held 1.755s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:00:01 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7819317-75eb-4f84-9f43-01ace5d6c18c" returned: 0 in 0.823s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] <== create_volume: return (2308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:00:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.311s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d28656-db7b-4d4e-a4f8-4e61c1629324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7819317-75eb-4f84-9f43-01ace5d6c18c', 'volume_size': 2}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1141de54-ac2a-4f0e-b89b-48acea99387d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:01 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-744c6284-e6f6-4fbf-a96f-f9b4ab2d1c64 tempest-VolumesActionsTest-49794276 None] Created reservations ['c495e641-e7f3-465a-8f30-b0413efbbde2', 'bf49e4f7-9d56-4d5b-9c92-15c28d790f82', 'bff382ce-7468-4457-b101-31037ef2df5e', '2348b850-9819-420e-b754-5fadec0d7c41'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:00:01 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Volume volume-b7819317-75eb-4f84-9f43-01ace5d6c18c (b7819317-75eb-4f84-9f43-01ace5d6c18c): created successfully Jun 03 12:00:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1141de54-ac2a-4f0e-b89b-48acea99387d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Flow 'volume_create_manager' (3a0b51bb-703c-4f77-a6dc-bc6606088b73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:02 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-dd7dfb2b-d3ba-4611-aa9e-513928dfa2cf tempest-VolumesCloneNegativeTest-777989088 None] Created volume successfully. Jun 03 12:00:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-744c6284-e6f6-4fbf-a96f-f9b4ab2d1c64 tempest-VolumesActionsTest-49794276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-744c6284-e6f6-4fbf-a96f-f9b4ab2d1c64 tempest-VolumesActionsTest-49794276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:02 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-744c6284-e6f6-4fbf-a96f-f9b4ab2d1c64 tempest-VolumesActionsTest-49794276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:00:02 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-744c6284-e6f6-4fbf-a96f-f9b4ab2d1c64 tempest-VolumesActionsTest-49794276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:00:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-744c6284-e6f6-4fbf-a96f-f9b4ab2d1c64 tempest-VolumesActionsTest-49794276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-744c6284-e6f6-4fbf-a96f-f9b4ab2d1c64 tempest-VolumesActionsTest-49794276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:02 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:00:02 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-744c6284-e6f6-4fbf-a96f-f9b4ab2d1c64 tempest-VolumesActionsTest-49794276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.683s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:02 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-744c6284-e6f6-4fbf-a96f-f9b4ab2d1c64 tempest-VolumesActionsTest-49794276 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:00:02 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:02 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-744c6284-e6f6-4fbf-a96f-f9b4ab2d1c64 tempest-VolumesActionsTest-49794276 None] Deleted volume successfully. Jun 03 12:00:02 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-744c6284-e6f6-4fbf-a96f-f9b4ab2d1c64 tempest-VolumesActionsTest-49794276 None] Lock "cinder-64dcd07d-3cb1-425b-8a02-107e3d31c9f1-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:00:02 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:00:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Flow 'volume_create_manager' (c62491b0-3775-47a7-a49c-b918f163c5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5f3af0-d4a5-4ccd-a08f-718021113f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5f3af0-d4a5-4ccd-a08f-718021113f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1878965213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89da9262-8377-4c96-81cc-d5188d28b71b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a8c6c009d1483da8aa7c9619c8349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:03Z,use_quota=True,user_id='ddf3d9669a524f89aaac8b4024a16d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (838bc9d3-1814-4435-b3b1-786d8b5b4ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (838bc9d3-1814-4435-b3b1-786d8b5b4ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24325b37-7238-43c7-9f22-f0dd003c70cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24325b37-7238-43c7-9f22-f0dd003c70cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89da9262-8377-4c96-81cc-d5188d28b71b', 'volume_name': 'volume-89da9262-8377-4c96-81cc-d5188d28b71b', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd57465a-e765-4dde-b98c-8970e223be5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd57465a-e765-4dde-b98c-8970e223be5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea35011-4914-4a88-9a11-1ed41ea73f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:03 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Volume 89da9262-8377-4c96-81cc-d5188d28b71b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89da9262-8377-4c96-81cc-d5188d28b71b', 'volume_size': 1} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1878965213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89da9262-8377-4c96-81cc-d5188d28b71b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a8c6c009d1483da8aa7c9619c8349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:03Z,use_quota=True,user_id='ddf3d9669a524f89aaac8b4024a16d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Creating volume 89da9262-8377-4c96-81cc-d5188d28b71b {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:00:03 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-89da9262-8377-4c96-81cc-d5188d28b71b 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:03 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-89da9262-8377-4c96-81cc-d5188d28b71b 1073741824 Jun 03 12:00:03 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fa35d534-5b00-4b5f-b5ae-c149f122aeaf tempest-VolumesCloneNegativeTest-777989088 None] Acquiring lock "cinder-b7819317-75eb-4f84-9f43-01ace5d6c18c-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fa35d534-5b00-4b5f-b5ae-c149f122aeaf tempest-VolumesCloneNegativeTest-777989088 None] Lock "cinder-b7819317-75eb-4f84-9f43-01ace5d6c18c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fa35d534-5b00-4b5f-b5ae-c149f122aeaf tempest-VolumesCloneNegativeTest-777989088 None] Acquiring lock "cinder-quobyte-b7819317-75eb-4f84-9f43-01ace5d6c18c" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fa35d534-5b00-4b5f-b5ae-c149f122aeaf tempest-VolumesCloneNegativeTest-777989088 None] Lock "cinder-quobyte-b7819317-75eb-4f84-9f43-01ace5d6c18c" acquired by "delete_volume" :: waited 0.016s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b2b7c5-bb0d-458d-afaf-f78534cbb085]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:00:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fa35d534-5b00-4b5f-b5ae-c149f122aeaf tempest-VolumesCloneNegativeTest-777989088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7819317-75eb-4f84-9f43-01ace5d6c18c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:03 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7819317-75eb-4f84-9f43-01ace5d6c18c Jun 03 12:00:03 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:04 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:00:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Flow 'volume_create_manager' (c0d66e0e-5776-481d-8f1f-e8260062da21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a869cb31-4051-4d6a-aaed-5aef0b0c79d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a869cb31-4051-4d6a-aaed-5aef0b0c79d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1707944205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec1ab70-5278-4f24-903a-216a1670eaad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1329f926e044fefa1d514f2c8b2edd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:04Z,use_quota=True,user_id='4d584039e2a7420ab73d4a4979820d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2831de-9ea2-4ffc-8895-9228021a1d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2831de-9ea2-4ffc-8895-9228021a1d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7560906a-69c6-4664-98cf-1d597efc99ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7560906a-69c6-4664-98cf-1d597efc99ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ec1ab70-5278-4f24-903a-216a1670eaad', 'volume_name': 'volume-5ec1ab70-5278-4f24-903a-216a1670eaad', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26781703-fa22-41df-8c5c-7f5bfaf9da6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26781703-fa22-41df-8c5c-7f5bfaf9da6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ddfcaa2-2ad9-4d80-b693-56093133cf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:04 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Volume 5ec1ab70-5278-4f24-903a-216a1670eaad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ec1ab70-5278-4f24-903a-216a1670eaad', 'volume_size': 1} Jun 03 12:00:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:04 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-89da9262-8377-4c96-81cc-d5188d28b71b 1073741824" returned: 0 in 1.108s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:04 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-89da9262-8377-4c96-81cc-d5188d28b71b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fa35d534-5b00-4b5f-b5ae-c149f122aeaf tempest-VolumesCloneNegativeTest-777989088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7819317-75eb-4f84-9f43-01ace5d6c18c" returned: 0 in 0.896s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fa35d534-5b00-4b5f-b5ae-c149f122aeaf tempest-VolumesCloneNegativeTest-777989088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7819317-75eb-4f84-9f43-01ace5d6c18c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:04 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-89da9262-8377-4c96-81cc-d5188d28b71b Jun 03 12:00:04 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:04 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7819317-75eb-4f84-9f43-01ace5d6c18c Jun 03 12:00:04 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:05 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-89da9262-8377-4c96-81cc-d5188d28b71b" returned: 0 in 0.885s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.963s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1707944205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec1ab70-5278-4f24-903a-216a1670eaad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1329f926e044fefa1d514f2c8b2edd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:04Z,use_quota=True,user_id='4d584039e2a7420ab73d4a4979820d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Creating volume 5ec1ab70-5278-4f24-903a-216a1670eaad {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:00:05 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ec1ab70-5278-4f24-903a-216a1670eaad 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea35011-4914-4a88-9a11-1ed41ea73f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89da9262-8377-4c96-81cc-d5188d28b71b', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:05 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ec1ab70-5278-4f24-903a-216a1670eaad 1073741824 Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (641c1229-aeca-4777-b8ba-0ee5e607c450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:05 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:05 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Volume volume-89da9262-8377-4c96-81cc-d5188d28b71b (89da9262-8377-4c96-81cc-d5188d28b71b): created successfully Jun 03 12:00:05 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (641c1229-aeca-4777-b8ba-0ee5e607c450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Flow 'volume_create_manager' (c62491b0-3775-47a7-a49c-b918f163c5de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fa35d534-5b00-4b5f-b5ae-c149f122aeaf tempest-VolumesCloneNegativeTest-777989088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7819317-75eb-4f84-9f43-01ace5d6c18c" returned: 0 in 0.959s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:05 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-2b644b4c-a9b9-46b6-bf9b-df9dc3699d08 tempest-VolumesActionsTest-111485632 None] Created volume successfully. Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fa35d534-5b00-4b5f-b5ae-c149f122aeaf tempest-VolumesCloneNegativeTest-777989088 None] Lock "cinder-quobyte-b7819317-75eb-4f84-9f43-01ace5d6c18c" released by "delete_volume" :: held 1.918s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-fa35d534-5b00-4b5f-b5ae-c149f122aeaf tempest-VolumesCloneNegativeTest-777989088 None] Created reservations ['e2d59595-630e-4da7-b195-42ab270dd08a', 'cef98d6f-d23f-4482-af87-c78ab1ac3646', '8e26d4c6-ec74-4845-ac6a-1e0f17b01b78', 'a9a41d12-549c-4211-aec8-c595ad0de99c'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fa35d534-5b00-4b5f-b5ae-c149f122aeaf tempest-VolumesCloneNegativeTest-777989088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fa35d534-5b00-4b5f-b5ae-c149f122aeaf tempest-VolumesCloneNegativeTest-777989088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fa35d534-5b00-4b5f-b5ae-c149f122aeaf tempest-VolumesCloneNegativeTest-777989088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fa35d534-5b00-4b5f-b5ae-c149f122aeaf tempest-VolumesCloneNegativeTest-777989088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fa35d534-5b00-4b5f-b5ae-c149f122aeaf tempest-VolumesCloneNegativeTest-777989088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fa35d534-5b00-4b5f-b5ae-c149f122aeaf tempest-VolumesCloneNegativeTest-777989088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:05 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:00:05 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:06 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fa35d534-5b00-4b5f-b5ae-c149f122aeaf tempest-VolumesCloneNegativeTest-777989088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.757s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:06 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-fa35d534-5b00-4b5f-b5ae-c149f122aeaf tempest-VolumesCloneNegativeTest-777989088 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:00:06 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:06 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-fa35d534-5b00-4b5f-b5ae-c149f122aeaf tempest-VolumesCloneNegativeTest-777989088 None] Deleted volume successfully. Jun 03 12:00:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ec1ab70-5278-4f24-903a-216a1670eaad 1073741824" returned: 0 in 1.040s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:06 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fa35d534-5b00-4b5f-b5ae-c149f122aeaf tempest-VolumesCloneNegativeTest-777989088 None] Lock "cinder-b7819317-75eb-4f84-9f43-01ace5d6c18c-delete_volume" released by "delete_volume" :: held 2.983s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:00:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ec1ab70-5278-4f24-903a-216a1670eaad {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:06 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ec1ab70-5278-4f24-903a-216a1670eaad Jun 03 12:00:06 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:06 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-89c25c4b-4b6e-4b2e-9a1c-93557516b2da tempest-VolumesActionsTest-49794276 None] Acquiring lock "cinder-89da9262-8377-4c96-81cc-d5188d28b71b-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:00:06 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-89c25c4b-4b6e-4b2e-9a1c-93557516b2da tempest-VolumesActionsTest-49794276 None] Lock "cinder-89da9262-8377-4c96-81cc-d5188d28b71b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:00:06 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-89c25c4b-4b6e-4b2e-9a1c-93557516b2da tempest-VolumesActionsTest-49794276 None] Acquiring lock "cinder-quobyte-89da9262-8377-4c96-81cc-d5188d28b71b" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:00:06 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-89c25c4b-4b6e-4b2e-9a1c-93557516b2da tempest-VolumesActionsTest-49794276 None] Lock "cinder-quobyte-89da9262-8377-4c96-81cc-d5188d28b71b" acquired by "delete_volume" :: waited 0.019s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:00:06 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd95b1c8-441f-4462-bbf3-f2cc9d449bbb]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:00:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-89c25c4b-4b6e-4b2e-9a1c-93557516b2da tempest-VolumesActionsTest-49794276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-89da9262-8377-4c96-81cc-d5188d28b71b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:06 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-89da9262-8377-4c96-81cc-d5188d28b71b Jun 03 12:00:06 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:07 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ec1ab70-5278-4f24-903a-216a1670eaad" returned: 0 in 1.011s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] <== create_volume: return (2117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:00:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.121s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ddfcaa2-2ad9-4d80-b693-56093133cf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ec1ab70-5278-4f24-903a-216a1670eaad', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d593da-c395-488e-a6cc-6ca809f4de4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:07 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Volume volume-5ec1ab70-5278-4f24-903a-216a1670eaad (5ec1ab70-5278-4f24-903a-216a1670eaad): created successfully Jun 03 12:00:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d593da-c395-488e-a6cc-6ca809f4de4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Flow 'volume_create_manager' (c0d66e0e-5776-481d-8f1f-e8260062da21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:07 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-f06662e2-4048-48e1-b506-00c7619a3c0e tempest-VolumeQuotasAdminTestJSON-2036784090 None] Created volume successfully. Jun 03 12:00:07 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-89c25c4b-4b6e-4b2e-9a1c-93557516b2da tempest-VolumesActionsTest-49794276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-89da9262-8377-4c96-81cc-d5188d28b71b" returned: 0 in 0.955s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-89c25c4b-4b6e-4b2e-9a1c-93557516b2da tempest-VolumesActionsTest-49794276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-89da9262-8377-4c96-81cc-d5188d28b71b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:07 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-89da9262-8377-4c96-81cc-d5188d28b71b Jun 03 12:00:07 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:08 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-89c25c4b-4b6e-4b2e-9a1c-93557516b2da tempest-VolumesActionsTest-49794276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-89da9262-8377-4c96-81cc-d5188d28b71b" returned: 0 in 0.715s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-89c25c4b-4b6e-4b2e-9a1c-93557516b2da tempest-VolumesActionsTest-49794276 None] Lock "cinder-quobyte-89da9262-8377-4c96-81cc-d5188d28b71b" released by "delete_volume" :: held 1.730s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:00:08 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-89c25c4b-4b6e-4b2e-9a1c-93557516b2da tempest-VolumesActionsTest-49794276 None] Created reservations ['9c819483-2e08-4afc-a17a-47e332cbb69a', 'aebfc96d-8c92-44ce-ae5a-a4402863feac', '7b90e446-2cd3-4b03-843f-0dbb4c848eaf', '8a947a55-8c18-451e-9ab9-01f9a05e49ca'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:00:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-89c25c4b-4b6e-4b2e-9a1c-93557516b2da tempest-VolumesActionsTest-49794276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-89c25c4b-4b6e-4b2e-9a1c-93557516b2da tempest-VolumesActionsTest-49794276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-89c25c4b-4b6e-4b2e-9a1c-93557516b2da tempest-VolumesActionsTest-49794276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:00:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-89c25c4b-4b6e-4b2e-9a1c-93557516b2da tempest-VolumesActionsTest-49794276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:00:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-89c25c4b-4b6e-4b2e-9a1c-93557516b2da tempest-VolumesActionsTest-49794276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-89c25c4b-4b6e-4b2e-9a1c-93557516b2da tempest-VolumesActionsTest-49794276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-6aceebea-31df-4306-ad53-4d44199e8e81 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Acquiring lock "cinder-5ec1ab70-5278-4f24-903a-216a1670eaad-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:00:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-6aceebea-31df-4306-ad53-4d44199e8e81 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Lock "cinder-5ec1ab70-5278-4f24-903a-216a1670eaad-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:00:08 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:00:08 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-6aceebea-31df-4306-ad53-4d44199e8e81 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Acquiring lock "cinder-quobyte-5ec1ab70-5278-4f24-903a-216a1670eaad" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:00:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-6aceebea-31df-4306-ad53-4d44199e8e81 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Lock "cinder-quobyte-5ec1ab70-5278-4f24-903a-216a1670eaad" acquired by "delete_volume" :: waited 0.026s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:00:08 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d73f1d-30d5-497a-a3aa-297fad380efc]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:00:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6aceebea-31df-4306-ad53-4d44199e8e81 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ec1ab70-5278-4f24-903a-216a1670eaad {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:08 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ec1ab70-5278-4f24-903a-216a1670eaad Jun 03 12:00:08 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Flow 'volume_create_manager' (f201b9a8-3239-4ebd-807a-ee09e8838625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f62e3f-90ca-49bc-a128-2b369adb5624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f62e3f-90ca-49bc-a128-2b369adb5624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1062006776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a40e7692-04ad-49c8-99a5-dc6ed8718c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a8c6c009d1483da8aa7c9619c8349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:09Z,use_quota=True,user_id='ddf3d9669a524f89aaac8b4024a16d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3456e726-e835-48cf-a2a6-342ccd81159c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3456e726-e835-48cf-a2a6-342ccd81159c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:09 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d677ea0-2706-4895-9d70-b162225b768e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d677ea0-2706-4895-9d70-b162225b768e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a40e7692-04ad-49c8-99a5-dc6ed8718c6f', 'volume_name': 'volume-a40e7692-04ad-49c8-99a5-dc6ed8718c6f', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13c726d-fc16-4ed3-9eb9-99613349d284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13c726d-fc16-4ed3-9eb9-99613349d284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc33b6d7-0e17-4f77-9062-ccc68095e75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:09 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Volume a40e7692-04ad-49c8-99a5-dc6ed8718c6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a40e7692-04ad-49c8-99a5-dc6ed8718c6f', 'volume_size': 1} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1062006776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a40e7692-04ad-49c8-99a5-dc6ed8718c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a8c6c009d1483da8aa7c9619c8349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:09Z,use_quota=True,user_id='ddf3d9669a524f89aaac8b4024a16d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Creating volume a40e7692-04ad-49c8-99a5-dc6ed8718c6f {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:00:09 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a40e7692-04ad-49c8-99a5-dc6ed8718c6f 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:09 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6aceebea-31df-4306-ad53-4d44199e8e81 tempest-VolumeQuotasAdminTestJSON-2036784090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ec1ab70-5278-4f24-903a-216a1670eaad" returned: 0 in 0.978s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-89c25c4b-4b6e-4b2e-9a1c-93557516b2da tempest-VolumesActionsTest-49794276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.165s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6aceebea-31df-4306-ad53-4d44199e8e81 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ec1ab70-5278-4f24-903a-216a1670eaad {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:09 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a40e7692-04ad-49c8-99a5-dc6ed8718c6f 1073741824 Jun 03 12:00:09 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-89c25c4b-4b6e-4b2e-9a1c-93557516b2da tempest-VolumesActionsTest-49794276 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:00:09 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ec1ab70-5278-4f24-903a-216a1670eaad Jun 03 12:00:09 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:09 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-89c25c4b-4b6e-4b2e-9a1c-93557516b2da tempest-VolumesActionsTest-49794276 None] Deleted volume successfully. Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Flow 'volume_create_manager' (42f63a64-ca1f-4627-9aba-aae875d0c1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a171129-a05e-4131-b4d3-74af4544b82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a171129-a05e-4131-b4d3-74af4544b82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-515100630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652df6a3-05d9-44f5-8a32-a481210b8a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd47427ce3640b4b13f6622eb47f150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:10Z,use_quota=True,user_id='b630319936654d249f3f47918f19cb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa6d50e-7823-4920-8aea-55ba5d8bac5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa6d50e-7823-4920-8aea-55ba5d8bac5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59ab82a-c546-44fc-9b0e-980224a34ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59ab82a-c546-44fc-9b0e-980224a34ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '652df6a3-05d9-44f5-8a32-a481210b8a7e', 'volume_name': 'volume-652df6a3-05d9-44f5-8a32-a481210b8a7e', 'volume_size': 2}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb37aec5-31c9-4408-8397-412c2b67b51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb37aec5-31c9-4408-8397-412c2b67b51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72cd4993-11f9-481d-8f14-d918f6555d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:09 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Volume 652df6a3-05d9-44f5-8a32-a481210b8a7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-652df6a3-05d9-44f5-8a32-a481210b8a7e', 'volume_size': 2} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:09 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-89c25c4b-4b6e-4b2e-9a1c-93557516b2da tempest-VolumesActionsTest-49794276 None] Lock "cinder-89da9262-8377-4c96-81cc-d5188d28b71b-delete_volume" released by "delete_volume" :: held 3.344s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:00:10 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6aceebea-31df-4306-ad53-4d44199e8e81 tempest-VolumeQuotasAdminTestJSON-2036784090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ec1ab70-5278-4f24-903a-216a1670eaad" returned: 0 in 0.652s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:10 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-6aceebea-31df-4306-ad53-4d44199e8e81 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Lock "cinder-quobyte-5ec1ab70-5278-4f24-903a-216a1670eaad" released by "delete_volume" :: held 1.719s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:00:10 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-6aceebea-31df-4306-ad53-4d44199e8e81 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Created reservations ['c06bd7eb-74af-4556-836d-df9f5fe51b72', '6c15f82e-ca93-4e51-a233-969961f004b7', '308138ec-ef03-49e3-af1c-8617bda4fd20', '4f2f120b-d78f-4f9c-9a78-e24f44ece6a2'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:00:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6aceebea-31df-4306-ad53-4d44199e8e81 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6aceebea-31df-4306-ad53-4d44199e8e81 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-6aceebea-31df-4306-ad53-4d44199e8e81 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:00:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-6aceebea-31df-4306-ad53-4d44199e8e81 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:00:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6aceebea-31df-4306-ad53-4d44199e8e81 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6aceebea-31df-4306-ad53-4d44199e8e81 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:10 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:00:10 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:10 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a40e7692-04ad-49c8-99a5-dc6ed8718c6f 1073741824" returned: 0 in 1.026s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a40e7692-04ad-49c8-99a5-dc6ed8718c6f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:10 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a40e7692-04ad-49c8-99a5-dc6ed8718c6f Jun 03 12:00:10 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:11 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Flow 'volume_create_manager' (af6f05d8-1a79-4026-b41d-98c30ee8c285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f04b69-b5e5-4b1c-b51c-6df265447cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6aceebea-31df-4306-ad53-4d44199e8e81 tempest-VolumeQuotasAdminTestJSON-2036784090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.892s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-6aceebea-31df-4306-ad53-4d44199e8e81 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:00:11 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-6aceebea-31df-4306-ad53-4d44199e8e81 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Deleted volume successfully. Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f04b69-b5e5-4b1c-b51c-6df265447cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1710463564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850e81ed-a8c3-4c5c-8759-dc2ae0854bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1329f926e044fefa1d514f2c8b2edd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:11Z,use_quota=True,user_id='4d584039e2a7420ab73d4a4979820d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c545b157-69dc-4b36-b9c2-0f7b9a8f315e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c545b157-69dc-4b36-b9c2-0f7b9a8f315e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fffdd6b7-434a-4c0e-a953-d89feafb471b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fffdd6b7-434a-4c0e-a953-d89feafb471b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '850e81ed-a8c3-4c5c-8759-dc2ae0854bf0', 'volume_name': 'volume-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4960c9-811e-4439-a0b8-8d08132e388b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4960c9-811e-4439-a0b8-8d08132e388b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b18ae002-b265-4c36-8dc4-4ee3b6c547fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:11 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Volume 850e81ed-a8c3-4c5c-8759-dc2ae0854bf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0', 'volume_size': 1} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-6aceebea-31df-4306-ad53-4d44199e8e81 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Lock "cinder-5ec1ab70-5278-4f24-903a-216a1670eaad-delete_volume" released by "delete_volume" :: held 2.912s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:00:11 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a40e7692-04ad-49c8-99a5-dc6ed8718c6f" returned: 0 in 0.765s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.691s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-515100630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652df6a3-05d9-44f5-8a32-a481210b8a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd47427ce3640b4b13f6622eb47f150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:10Z,use_quota=True,user_id='b630319936654d249f3f47918f19cb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Creating volume 652df6a3-05d9-44f5-8a32-a481210b8a7e {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:00:11 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e 2147483648 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:11 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e 2147483648 Jun 03 12:00:11 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc33b6d7-0e17-4f77-9062-ccc68095e75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a40e7692-04ad-49c8-99a5-dc6ed8718c6f', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6c600b6-9996-407c-b26e-5295f05f88c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:11 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Volume volume-a40e7692-04ad-49c8-99a5-dc6ed8718c6f (a40e7692-04ad-49c8-99a5-dc6ed8718c6f): created successfully Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6c600b6-9996-407c-b26e-5295f05f88c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Flow 'volume_create_manager' (f201b9a8-3239-4ebd-807a-ee09e8838625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:11 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-4a5abb45-219e-4cd1-a6e0-b36a832d9385 tempest-VolumesActionsTest-111485632 None] Created volume successfully. Jun 03 12:00:12 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e 2147483648" returned: 0 in 0.921s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:12 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e Jun 03 12:00:12 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:12 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b127cdca-9002-4bdc-9e9c-6e29516c1951 tempest-VolumesActionsTest-49794276 None] Acquiring lock "cinder-a40e7692-04ad-49c8-99a5-dc6ed8718c6f-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:00:12 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b127cdca-9002-4bdc-9e9c-6e29516c1951 tempest-VolumesActionsTest-49794276 None] Lock "cinder-a40e7692-04ad-49c8-99a5-dc6ed8718c6f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b127cdca-9002-4bdc-9e9c-6e29516c1951 tempest-VolumesActionsTest-49794276 None] Acquiring lock "cinder-quobyte-a40e7692-04ad-49c8-99a5-dc6ed8718c6f" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b127cdca-9002-4bdc-9e9c-6e29516c1951 tempest-VolumesActionsTest-49794276 None] Lock "cinder-quobyte-a40e7692-04ad-49c8-99a5-dc6ed8718c6f" acquired by "delete_volume" :: waited 0.017s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4eaf9d0-2090-43fa-8d4e-61bc1ee2244a]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b127cdca-9002-4bdc-9e9c-6e29516c1951 tempest-VolumesActionsTest-49794276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a40e7692-04ad-49c8-99a5-dc6ed8718c6f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:13 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a40e7692-04ad-49c8-99a5-dc6ed8718c6f Jun 03 12:00:13 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:13 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e" returned: 0 in 0.742s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.780s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1710463564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850e81ed-a8c3-4c5c-8759-dc2ae0854bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1329f926e044fefa1d514f2c8b2edd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:11Z,use_quota=True,user_id='4d584039e2a7420ab73d4a4979820d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Creating volume 850e81ed-a8c3-4c5c-8759-dc2ae0854bf0 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:00:13 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72cd4993-11f9-481d-8f14-d918f6555d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-652df6a3-05d9-44f5-8a32-a481210b8a7e', 'volume_size': 2}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:13 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0 1073741824 Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc16a5e1-9df0-4ec8-a6ea-fb4308267695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:13 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:13 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Volume volume-652df6a3-05d9-44f5-8a32-a481210b8a7e (652df6a3-05d9-44f5-8a32-a481210b8a7e): created successfully Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc16a5e1-9df0-4ec8-a6ea-fb4308267695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Flow 'volume_create_manager' (42f63a64-ca1f-4627-9aba-aae875d0c1fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:13 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d39938a5-6e25-439f-8195-902df9ed1c00 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Created volume successfully. Jun 03 12:00:13 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b127cdca-9002-4bdc-9e9c-6e29516c1951 tempest-VolumesActionsTest-49794276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a40e7692-04ad-49c8-99a5-dc6ed8718c6f" returned: 0 in 0.850s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b127cdca-9002-4bdc-9e9c-6e29516c1951 tempest-VolumesActionsTest-49794276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a40e7692-04ad-49c8-99a5-dc6ed8718c6f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:13 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a40e7692-04ad-49c8-99a5-dc6ed8718c6f Jun 03 12:00:13 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b96d9476-ff39-4830-af48-388a38dc00af tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:14 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0 1073741824" returned: 0 in 1.072s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:14 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0 Jun 03 12:00:14 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:14 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b127cdca-9002-4bdc-9e9c-6e29516c1951 tempest-VolumesActionsTest-49794276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a40e7692-04ad-49c8-99a5-dc6ed8718c6f" returned: 0 in 0.784s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:14 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b127cdca-9002-4bdc-9e9c-6e29516c1951 tempest-VolumesActionsTest-49794276 None] Lock "cinder-quobyte-a40e7692-04ad-49c8-99a5-dc6ed8718c6f" released by "delete_volume" :: held 1.685s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:00:14 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-b127cdca-9002-4bdc-9e9c-6e29516c1951 tempest-VolumesActionsTest-49794276 None] Created reservations ['3b9c8bfe-ae56-4fdf-bf26-169531bdb52c', '19b54fb6-93ed-42db-8ef1-b34a43fa9c35', '281fed79-a9f3-4811-b229-93ca227ed2f4', 'e22ccf09-b112-4351-bac7-6a20ad041705'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:00:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b127cdca-9002-4bdc-9e9c-6e29516c1951 tempest-VolumesActionsTest-49794276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b127cdca-9002-4bdc-9e9c-6e29516c1951 tempest-VolumesActionsTest-49794276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:14 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b127cdca-9002-4bdc-9e9c-6e29516c1951 tempest-VolumesActionsTest-49794276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:00:14 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b127cdca-9002-4bdc-9e9c-6e29516c1951 tempest-VolumesActionsTest-49794276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:00:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b127cdca-9002-4bdc-9e9c-6e29516c1951 tempest-VolumesActionsTest-49794276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b127cdca-9002-4bdc-9e9c-6e29516c1951 tempest-VolumesActionsTest-49794276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:14 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:00:14 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:15 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0" returned: 0 in 0.669s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:00:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b96d9476-ff39-4830-af48-388a38dc00af tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.732s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b18ae002-b265-4c36-8dc4-4ee3b6c547fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b4e405-c842-4877-9dca-c715a5046f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-b96d9476-ff39-4830-af48-388a38dc00af tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Creating offline snapshot c6246428-b8b5-4883-83da-42b58d89628a of volume 652df6a3-05d9-44f5-8a32-a481210b8a7e {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 12:00:15 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Volume volume-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0 (850e81ed-a8c3-4c5c-8759-dc2ae0854bf0): created successfully Jun 03 12:00:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b4e405-c842-4877-9dca-c715a5046f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Flow 'volume_create_manager' (af6f05d8-1a79-4026-b41d-98c30ee8c285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:15 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a4a60d-bafd-4e20-8881-89f1c82c38e4]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:00:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b96d9476-ff39-4830-af48-388a38dc00af tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:15 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-958388c9-b71b-4c40-a60d-3faf7ab7ff03 tempest-VolumeQuotasAdminTestJSON-2036784090 None] Created volume successfully. Jun 03 12:00:15 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e Jun 03 12:00:15 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:15 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b127cdca-9002-4bdc-9e9c-6e29516c1951 tempest-VolumesActionsTest-49794276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.987s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:15 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-b127cdca-9002-4bdc-9e9c-6e29516c1951 tempest-VolumesActionsTest-49794276 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:00:15 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-b127cdca-9002-4bdc-9e9c-6e29516c1951 tempest-VolumesActionsTest-49794276 None] Deleted volume successfully. Jun 03 12:00:15 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b127cdca-9002-4bdc-9e9c-6e29516c1951 tempest-VolumesActionsTest-49794276 None] Lock "cinder-a40e7692-04ad-49c8-99a5-dc6ed8718c6f-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:00:15 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:00:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Flow 'volume_create_manager' (66492a00-8e47-4d4c-a975-66877bcb88fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5f3958-aec2-4636-a55d-6acf1c2b9efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5f3958-aec2-4636-a55d-6acf1c2b9efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1813458824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01551e5-54b8-4989-b901-658c5d95ee23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a8c6c009d1483da8aa7c9619c8349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:16Z,use_quota=True,user_id='ddf3d9669a524f89aaac8b4024a16d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c33266-3c39-453b-93fb-ad70a321cc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c33266-3c39-453b-93fb-ad70a321cc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330fcb09-b32e-4c86-88c8-c5c1c172ebdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330fcb09-b32e-4c86-88c8-c5c1c172ebdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e01551e5-54b8-4989-b901-658c5d95ee23', 'volume_name': 'volume-e01551e5-54b8-4989-b901-658c5d95ee23', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9e6510-e896-49e8-bb77-4d4c236bc571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9e6510-e896-49e8-bb77-4d4c236bc571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc19275a-15a7-49d7-b22e-8daa369cee23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:16 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Volume e01551e5-54b8-4989-b901-658c5d95ee23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e01551e5-54b8-4989-b901-658c5d95ee23', 'volume_size': 1} Jun 03 12:00:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:16 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b96d9476-ff39-4830-af48-388a38dc00af tempest-VolumesSnapshotNegativeTestJSON-260397136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e" returned: 0 in 1.015s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b96d9476-ff39-4830-af48-388a38dc00af tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.c6246428-b8b5-4883-83da-42b58d89628a 2G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:16 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.c6246428-b8b5-4883-83da-42b58d89628a 2G Jun 03 12:00:16 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:16 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-533cf096-a155-4a81-be0d-aae38fcc3f86 tempest-VolumeQuotasAdminTestJSON-239423269 None] Transfer volume completed successfully. Jun 03 12:00:17 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b96d9476-ff39-4830-af48-388a38dc00af tempest-VolumesSnapshotNegativeTestJSON-260397136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.c6246428-b8b5-4883-83da-42b58d89628a 2G" returned: 0 in 0.852s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b96d9476-ff39-4830-af48-388a38dc00af tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652df6a3-05d9-44f5-8a32-a481210b8a7e -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.c6246428-b8b5-4883-83da-42b58d89628a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:17 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652df6a3-05d9-44f5-8a32-a481210b8a7e -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.c6246428-b8b5-4883-83da-42b58d89628a Jun 03 12:00:17 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:17 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-78ad2f15-75da-4c5d-bb54-15d56914efb1 tempest-VolumeQuotasAdminTestJSON-1330714279 None] Acquiring lock "cinder-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:00:17 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-78ad2f15-75da-4c5d-bb54-15d56914efb1 tempest-VolumeQuotasAdminTestJSON-1330714279 None] Lock "cinder-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:00:17 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=124,cinder:INSERT=40,cinder:UPDATE=190,cinder:DELETE=13 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:00:17 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=130,cinder:UPDATE=175,cinder:DELETE=15,cinder:INSERT=43 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:00:17 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-78ad2f15-75da-4c5d-bb54-15d56914efb1 tempest-VolumeQuotasAdminTestJSON-1330714279 None] Acquiring lock "cinder-quobyte-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:00:17 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-78ad2f15-75da-4c5d-bb54-15d56914efb1 tempest-VolumeQuotasAdminTestJSON-1330714279 None] Lock "cinder-quobyte-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0" acquired by "delete_volume" :: waited 0.023s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:00:17 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cb8999-3eca-457d-80d7-9ed285506bd7]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:00:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-78ad2f15-75da-4c5d-bb54-15d56914efb1 tempest-VolumeQuotasAdminTestJSON-1330714279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:17 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b96d9476-ff39-4830-af48-388a38dc00af tempest-VolumesSnapshotNegativeTestJSON-260397136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652df6a3-05d9-44f5-8a32-a481210b8a7e -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.c6246428-b8b5-4883-83da-42b58d89628a" returned: 0 in 0.781s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:17 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-b96d9476-ff39-4830-af48-388a38dc00af tempest-VolumesSnapshotNegativeTestJSON-260397136 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.c6246428-b8b5-4883-83da-42b58d89628a is being set with open permissions: ugo+rw Jun 03 12:00:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b96d9476-ff39-4830-af48-388a38dc00af tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.c6246428-b8b5-4883-83da-42b58d89628a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:17 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.c6246428-b8b5-4883-83da-42b58d89628a Jun 03 12:00:17 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:17 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0 Jun 03 12:00:17 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:18 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b96d9476-ff39-4830-af48-388a38dc00af tempest-VolumesSnapshotNegativeTestJSON-260397136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.c6246428-b8b5-4883-83da-42b58d89628a" returned: 0 in 0.798s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:18 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-78ad2f15-75da-4c5d-bb54-15d56914efb1 tempest-VolumeQuotasAdminTestJSON-1330714279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0" returned: 0 in 0.856s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-78ad2f15-75da-4c5d-bb54-15d56914efb1 tempest-VolumeQuotasAdminTestJSON-1330714279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b96d9476-ff39-4830-af48-388a38dc00af tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:18 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0 Jun 03 12:00:18 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:18 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.info Jun 03 12:00:18 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:19 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-78ad2f15-75da-4c5d-bb54-15d56914efb1 tempest-VolumeQuotasAdminTestJSON-1330714279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0" returned: 0 in 0.669s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:19 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b96d9476-ff39-4830-af48-388a38dc00af tempest-VolumesSnapshotNegativeTestJSON-260397136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.info" returned: 0 in 0.673s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:19 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-b96d9476-ff39-4830-af48-388a38dc00af tempest-VolumesSnapshotNegativeTestJSON-260397136 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.info is being set with open permissions: ugo+rw Jun 03 12:00:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b96d9476-ff39-4830-af48-388a38dc00af tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:19 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-78ad2f15-75da-4c5d-bb54-15d56914efb1 tempest-VolumeQuotasAdminTestJSON-1330714279 None] Lock "cinder-quobyte-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0" released by "delete_volume" :: held 1.591s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:00:19 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.info Jun 03 12:00:19 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:19 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-78ad2f15-75da-4c5d-bb54-15d56914efb1 tempest-VolumeQuotasAdminTestJSON-1330714279 None] Created reservations ['9257343b-da48-4d34-9d42-e055c765ad9b', '8ea0d781-f888-4742-8eec-afb935fb114a', 'e5621213-5359-4618-b44e-7a7b6b47b15f', 'd03aafa4-a54c-4173-a8a6-f81caebc7082'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:00:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-78ad2f15-75da-4c5d-bb54-15d56914efb1 tempest-VolumeQuotasAdminTestJSON-1330714279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-78ad2f15-75da-4c5d-bb54-15d56914efb1 tempest-VolumeQuotasAdminTestJSON-1330714279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-78ad2f15-75da-4c5d-bb54-15d56914efb1 tempest-VolumeQuotasAdminTestJSON-1330714279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:00:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-78ad2f15-75da-4c5d-bb54-15d56914efb1 tempest-VolumeQuotasAdminTestJSON-1330714279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:00:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-78ad2f15-75da-4c5d-bb54-15d56914efb1 tempest-VolumeQuotasAdminTestJSON-1330714279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-78ad2f15-75da-4c5d-bb54-15d56914efb1 tempest-VolumeQuotasAdminTestJSON-1330714279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:19 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:00:19 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:20 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b96d9476-ff39-4830-af48-388a38dc00af tempest-VolumesSnapshotNegativeTestJSON-260397136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.info" returned: 0 in 0.768s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b96d9476-ff39-4830-af48-388a38dc00af tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.088s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.156s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1813458824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01551e5-54b8-4989-b901-658c5d95ee23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a8c6c009d1483da8aa7c9619c8349b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:16Z,use_quota=True,user_id='ddf3d9669a524f89aaac8b4024a16d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Creating volume e01551e5-54b8-4989-b901-658c5d95ee23 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:00:20 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e01551e5-54b8-4989-b901-658c5d95ee23 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:20 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e01551e5-54b8-4989-b901-658c5d95ee23 1073741824 Jun 03 12:00:20 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-b96d9476-ff39-4830-af48-388a38dc00af tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Create snapshot completed successfully Jun 03 12:00:20 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:20 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-78ad2f15-75da-4c5d-bb54-15d56914efb1 tempest-VolumeQuotasAdminTestJSON-1330714279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.964s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-78ad2f15-75da-4c5d-bb54-15d56914efb1 tempest-VolumeQuotasAdminTestJSON-1330714279 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:00:20 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-78ad2f15-75da-4c5d-bb54-15d56914efb1 tempest-VolumeQuotasAdminTestJSON-1330714279 None] Deleted volume successfully. Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-78ad2f15-75da-4c5d-bb54-15d56914efb1 tempest-VolumeQuotasAdminTestJSON-1330714279 None] Lock "cinder-850e81ed-a8c3-4c5c-8759-dc2ae0854bf0-delete_volume" released by "delete_volume" :: held 2.827s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Acquiring lock "cinder-c6246428-b8b5-4883-83da-42b58d89628a-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Lock "cinder-c6246428-b8b5-4883-83da-42b58d89628a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Acquiring lock "cinder-quobyte-652df6a3-05d9-44f5-8a32-a481210b8a7e" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Lock "cinder-quobyte-652df6a3-05d9-44f5-8a32-a481210b8a7e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Acquiring lock "cinder-quobyte-c6246428-b8b5-4883-83da-42b58d89628a" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Lock "cinder-quobyte-c6246428-b8b5-4883-83da-42b58d89628a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:00:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Deleting offline snapshot c6246428-b8b5-4883-83da-42b58d89628a of volume 652df6a3-05d9-44f5-8a32-a481210b8a7e {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 12:00:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] snapshot_file for this snap is: volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.c6246428-b8b5-4883-83da-42b58d89628a {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 12:00:21 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c0908b-4117-48e8-844b-27f9597283d0]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:00:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.c6246428-b8b5-4883-83da-42b58d89628a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:21 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.c6246428-b8b5-4883-83da-42b58d89628a Jun 03 12:00:21 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:21 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e01551e5-54b8-4989-b901-658c5d95ee23 1073741824" returned: 0 in 1.313s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e01551e5-54b8-4989-b901-658c5d95ee23 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:21 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e01551e5-54b8-4989-b901-658c5d95ee23 Jun 03 12:00:21 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:21 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.c6246428-b8b5-4883-83da-42b58d89628a" returned: 0 in 0.881s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-652df6a3-05d9-44f5-8a32-a481210b8a7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:00:22 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a07e464-572c-40ca-990d-2702ccf3c7e8]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:00:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:22 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e Jun 03 12:00:22 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:22 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e01551e5-54b8-4989-b901-658c5d95ee23" returned: 0 in 0.840s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] <== create_volume: return (2246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:00:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.260s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc19275a-15a7-49d7-b22e-8daa369cee23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e01551e5-54b8-4989-b901-658c5d95ee23', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8122a43-11ff-45e6-9aa0-5ea6d653501e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:22 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Volume volume-e01551e5-54b8-4989-b901-658c5d95ee23 (e01551e5-54b8-4989-b901-658c5d95ee23): created successfully Jun 03 12:00:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8122a43-11ff-45e6-9aa0-5ea6d653501e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Flow 'volume_create_manager' (66492a00-8e47-4d4c-a975-66877bcb88fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:22 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-2d5f629e-30b2-4c5f-81e5-a98c977aa64a tempest-VolumesActionsTest-111485632 None] Created volume successfully. Jun 03 12:00:22 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e" returned: 0 in 0.953s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.c6246428-b8b5-4883-83da-42b58d89628a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:22 devstack sudo[97192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.c6246428-b8b5-4883-83da-42b58d89628a Jun 03 12:00:22 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:23 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.c6246428-b8b5-4883-83da-42b58d89628a" returned: 0 in 0.957s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.c6246428-b8b5-4883-83da-42b58d89628a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:23 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.c6246428-b8b5-4883-83da-42b58d89628a Jun 03 12:00:23 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c4e3ceb1-2d9b-4670-a40b-292a600ee326 tempest-VolumesActionsTest-111485632 None] Acquiring lock "cinder-e01551e5-54b8-4989-b901-658c5d95ee23-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:00:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c4e3ceb1-2d9b-4670-a40b-292a600ee326 tempest-VolumesActionsTest-111485632 None] Lock "cinder-e01551e5-54b8-4989-b901-658c5d95ee23-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:00:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c4e3ceb1-2d9b-4670-a40b-292a600ee326 tempest-VolumesActionsTest-111485632 None] Acquiring lock "cinder-quobyte-e01551e5-54b8-4989-b901-658c5d95ee23" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:00:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c4e3ceb1-2d9b-4670-a40b-292a600ee326 tempest-VolumesActionsTest-111485632 None] Lock "cinder-quobyte-e01551e5-54b8-4989-b901-658c5d95ee23" acquired by "delete_volume" :: waited 0.022s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:00:24 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ea8616-611b-4bd0-90e1-33ebed99bdc6]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:00:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c4e3ceb1-2d9b-4670-a40b-292a600ee326 tempest-VolumesActionsTest-111485632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e01551e5-54b8-4989-b901-658c5d95ee23 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:24 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e.c6246428-b8b5-4883-83da-42b58d89628a" returned: 0 in 0.869s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:24 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e01551e5-54b8-4989-b901-658c5d95ee23 Jun 03 12:00:24 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Lock "cinder-quobyte-c6246428-b8b5-4883-83da-42b58d89628a" released by "_delete_snapshot" :: held 3.859s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:00:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Lock "cinder-quobyte-652df6a3-05d9-44f5-8a32-a481210b8a7e" released by "delete_snapshot" :: held 3.896s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:00:24 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Created reservations ['4eb2f180-7fe5-4cb7-be1d-6849c99f2cb0', 'df76c5d8-b422-41f3-a271-8c38693083d2', '15811634-6bac-498a-bc0a-6b5ec539e0b0', '5e025f24-f75d-436d-962a-302f38da6e7c'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:00:25 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Delete snapshot completed successfully. Jun 03 12:00:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7d154e0d-42e6-4d04-ad0d-3b3bf41cb248 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Lock "cinder-c6246428-b8b5-4883-83da-42b58d89628a-delete_snapshot" released by "delete_snapshot" :: held 4.157s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:00:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1ea50c94-dc05-4714-9e36-43f09c4b7767 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Acquiring lock "cinder-652df6a3-05d9-44f5-8a32-a481210b8a7e-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:00:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1ea50c94-dc05-4714-9e36-43f09c4b7767 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Lock "cinder-652df6a3-05d9-44f5-8a32-a481210b8a7e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:00:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1ea50c94-dc05-4714-9e36-43f09c4b7767 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Acquiring lock "cinder-quobyte-652df6a3-05d9-44f5-8a32-a481210b8a7e" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:00:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1ea50c94-dc05-4714-9e36-43f09c4b7767 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Lock "cinder-quobyte-652df6a3-05d9-44f5-8a32-a481210b8a7e" acquired by "delete_volume" :: waited 0.030s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:00:25 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80ecd35-061a-4fdb-b6d8-b2686d3a8031]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:00:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1ea50c94-dc05-4714-9e36-43f09c4b7767 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:25 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e Jun 03 12:00:25 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:25 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c4e3ceb1-2d9b-4670-a40b-292a600ee326 tempest-VolumesActionsTest-111485632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e01551e5-54b8-4989-b901-658c5d95ee23" returned: 0 in 1.231s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c4e3ceb1-2d9b-4670-a40b-292a600ee326 tempest-VolumesActionsTest-111485632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e01551e5-54b8-4989-b901-658c5d95ee23 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:25 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e01551e5-54b8-4989-b901-658c5d95ee23 Jun 03 12:00:25 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:26 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1ea50c94-dc05-4714-9e36-43f09c4b7767 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e" returned: 0 in 0.983s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1ea50c94-dc05-4714-9e36-43f09c4b7767 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:26 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e Jun 03 12:00:26 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:26 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c4e3ceb1-2d9b-4670-a40b-292a600ee326 tempest-VolumesActionsTest-111485632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e01551e5-54b8-4989-b901-658c5d95ee23" returned: 0 in 0.736s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c4e3ceb1-2d9b-4670-a40b-292a600ee326 tempest-VolumesActionsTest-111485632 None] Lock "cinder-quobyte-e01551e5-54b8-4989-b901-658c5d95ee23" released by "delete_volume" :: held 2.029s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:00:27 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1ea50c94-dc05-4714-9e36-43f09c4b7767 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-652df6a3-05d9-44f5-8a32-a481210b8a7e" returned: 0 in 0.638s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1ea50c94-dc05-4714-9e36-43f09c4b7767 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Lock "cinder-quobyte-652df6a3-05d9-44f5-8a32-a481210b8a7e" released by "delete_volume" :: held 1.712s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:00:27 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-c4e3ceb1-2d9b-4670-a40b-292a600ee326 tempest-VolumesActionsTest-111485632 None] Created reservations ['b16ffa08-cf16-4c2a-8dfe-d506d032e04f', 'ab5ec2ec-7059-475c-adbe-2ecf07f1f849', '8fee58fd-16a1-4593-a16f-987c4452b91d', '6696c07b-fb1b-4e14-affb-4c367817936a'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:00:28 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-1ea50c94-dc05-4714-9e36-43f09c4b7767 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Created reservations ['e8967aeb-e9f3-4c2d-adf2-1bfab42bb41a', '8d8642cd-601b-46c2-9d1d-59ccb22817db', '4142afdf-6efb-4844-a13b-5d35bb2eba3e', '865cda96-904e-4476-b27c-d025ec006146'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:00:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c4e3ceb1-2d9b-4670-a40b-292a600ee326 tempest-VolumesActionsTest-111485632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c4e3ceb1-2d9b-4670-a40b-292a600ee326 tempest-VolumesActionsTest-111485632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:31 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c4e3ceb1-2d9b-4670-a40b-292a600ee326 tempest-VolumesActionsTest-111485632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:00:31 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c4e3ceb1-2d9b-4670-a40b-292a600ee326 tempest-VolumesActionsTest-111485632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:00:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c4e3ceb1-2d9b-4670-a40b-292a600ee326 tempest-VolumesActionsTest-111485632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c4e3ceb1-2d9b-4670-a40b-292a600ee326 tempest-VolumesActionsTest-111485632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:31 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:00:31 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:32 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c4e3ceb1-2d9b-4670-a40b-292a600ee326 tempest-VolumesActionsTest-111485632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.640s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:32 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-c4e3ceb1-2d9b-4670-a40b-292a600ee326 tempest-VolumesActionsTest-111485632 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:00:32 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c4e3ceb1-2d9b-4670-a40b-292a600ee326 tempest-VolumesActionsTest-111485632 None] Deleted volume successfully. Jun 03 12:00:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1ea50c94-dc05-4714-9e36-43f09c4b7767 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1ea50c94-dc05-4714-9e36-43f09c4b7767 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:32 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1ea50c94-dc05-4714-9e36-43f09c4b7767 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:00:32 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1ea50c94-dc05-4714-9e36-43f09c4b7767 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:00:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1ea50c94-dc05-4714-9e36-43f09c4b7767 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1ea50c94-dc05-4714-9e36-43f09c4b7767 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c4e3ceb1-2d9b-4670-a40b-292a600ee326 tempest-VolumesActionsTest-111485632 None] Lock "cinder-e01551e5-54b8-4989-b901-658c5d95ee23-delete_volume" released by "delete_volume" :: held 7.733s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:00:32 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:00:32 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:33 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1ea50c94-dc05-4714-9e36-43f09c4b7767 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.853s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:33 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-1ea50c94-dc05-4714-9e36-43f09c4b7767 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:00:33 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-1ea50c94-dc05-4714-9e36-43f09c4b7767 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Deleted volume successfully. Jun 03 12:00:33 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1ea50c94-dc05-4714-9e36-43f09c4b7767 tempest-VolumesSnapshotNegativeTestJSON-260397136 None] Lock "cinder-652df6a3-05d9-44f5-8a32-a481210b8a7e-delete_volume" released by "delete_volume" :: held 7.786s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:00:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 12:00:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:00:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:00:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:36 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:00:36 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Flow 'volume_create_manager' (b1ea34e0-ce28-4b95-8584-08e9d60b616b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87eded83-2734-4f25-bdf2-0f760303b6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87eded83-2734-4f25-bdf2-0f760303b6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-36024071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38057ac-fc20-49ab-acaa-1bfab8773e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e18f985bdf240a9a0dd4943d002ddac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:38Z,use_quota=True,user_id='d087581259f343969d8767b233da980e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969e93f9-3b5d-40e9-bc97-27f4160ac761),volume_type_id=969e93f9-3b5d-40e9-bc97-27f4160ac761)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573780b3-2a92-43af-ba02-a72591bd5255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573780b3-2a92-43af-ba02-a72591bd5255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a9a3b6-0c02-4c2b-ad95-4e783a7ad00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a9a3b6-0c02-4c2b-ad95-4e783a7ad00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd38057ac-fc20-49ab-acaa-1bfab8773e6b', 'volume_name': 'volume-d38057ac-fc20-49ab-acaa-1bfab8773e6b', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2b1242-0022-4fd3-b843-2b4df24d13e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2b1242-0022-4fd3-b843-2b4df24d13e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78dc2cb-140b-4430-b86c-16db3341df5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:37 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Volume d38057ac-fc20-49ab-acaa-1bfab8773e6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d38057ac-fc20-49ab-acaa-1bfab8773e6b', 'volume_size': 1} Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-36024071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38057ac-fc20-49ab-acaa-1bfab8773e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e18f985bdf240a9a0dd4943d002ddac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:38Z,use_quota=True,user_id='d087581259f343969d8767b233da980e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969e93f9-3b5d-40e9-bc97-27f4160ac761),volume_type_id=969e93f9-3b5d-40e9-bc97-27f4160ac761)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Creating volume d38057ac-fc20-49ab-acaa-1bfab8773e6b {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:00:37 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:00:37 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:00:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d38057ac-fc20-49ab-acaa-1bfab8773e6b 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.142s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:38 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:00:38 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d38057ac-fc20-49ab-acaa-1bfab8773e6b 1073741824 Jun 03 12:00:38 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:38 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:00:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Flow 'volume_create_manager' (91f3f13a-4779-41d0-a451-98883c00832c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5919a0d0-eda4-481b-a615-2d394cf76c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5919a0d0-eda4-481b-a615-2d394cf76c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-309104902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6c0317-2671-4770-a722-7b7e1ad020b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee551dc80854918b7177bad04c3e028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:39Z,use_quota=True,user_id='7f3b5dc124ac44a48e60ed46481a3b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce690d2c-cda3-469a-b7e7-87d7b40574bf),volume_type_id=ce690d2c-cda3-469a-b7e7-87d7b40574bf)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa41ae2-812c-4bc0-900f-f466742ac660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa41ae2-812c-4bc0-900f-f466742ac660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1414b2-37fc-461b-b932-c25d0f77efb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1414b2-37fc-461b-b932-c25d0f77efb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c6c0317-2671-4770-a722-7b7e1ad020b4', 'volume_name': 'volume-5c6c0317-2671-4770-a722-7b7e1ad020b4', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba7cdd1-1364-4df1-8b9f-ef911ad2c6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba7cdd1-1364-4df1-8b9f-ef911ad2c6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783f910a-57bc-4ccc-9295-652a7c2dcea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:38 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Volume 5c6c0317-2671-4770-a722-7b7e1ad020b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c6c0317-2671-4770-a722-7b7e1ad020b4', 'volume_size': 1} Jun 03 12:00:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:39 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d38057ac-fc20-49ab-acaa-1bfab8773e6b 1073741824" returned: 0 in 1.298s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:39 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:00:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Flow 'volume_create_manager' (29d2ccaa-46be-4dcb-ae3b-75d56d7d3c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7b1c92-747e-484e-872c-685d8299ef31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d38057ac-fc20-49ab-acaa-1bfab8773e6b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:39 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d38057ac-fc20-49ab-acaa-1bfab8773e6b Jun 03 12:00:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7b1c92-747e-484e-872c-685d8299ef31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2021613919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d827b0-3b70-40e0-a29e-aef847f48b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee551dc80854918b7177bad04c3e028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:39Z,use_quota=True,user_id='7f3b5dc124ac44a48e60ed46481a3b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fe637bc-6b0e-49b0-98ea-bab8d4297fa4),volume_type_id=6fe637bc-6b0e-49b0-98ea-bab8d4297fa4)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:39 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02773626-b496-4250-848d-3c7fea39b8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02773626-b496-4250-848d-3c7fea39b8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e273c95f-8ea8-4294-b7d3-f560a81dc677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e273c95f-8ea8-4294-b7d3-f560a81dc677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00d827b0-3b70-40e0-a29e-aef847f48b1c', 'volume_name': 'volume-00d827b0-3b70-40e0-a29e-aef847f48b1c', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b07ab86-6eea-4973-8844-d51bced249f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b07ab86-6eea-4973-8844-d51bced249f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1d418e-a5b2-4b08-8877-51f9a66e9bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:39 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Volume 00d827b0-3b70-40e0-a29e-aef847f48b1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00d827b0-3b70-40e0-a29e-aef847f48b1c', 'volume_size': 1} Jun 03 12:00:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:40 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d38057ac-fc20-49ab-acaa-1bfab8773e6b" returned: 0 in 0.847s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] <== create_volume: return (2300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.307s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.366s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-309104902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6c0317-2671-4770-a722-7b7e1ad020b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee551dc80854918b7177bad04c3e028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:39Z,use_quota=True,user_id='7f3b5dc124ac44a48e60ed46481a3b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce690d2c-cda3-469a-b7e7-87d7b40574bf),volume_type_id=ce690d2c-cda3-469a-b7e7-87d7b40574bf)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Creating volume 5c6c0317-2671-4770-a722-7b7e1ad020b4 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:00:40 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5c6c0317-2671-4770-a722-7b7e1ad020b4 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78dc2cb-140b-4430-b86c-16db3341df5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d38057ac-fc20-49ab-acaa-1bfab8773e6b', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:40 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5c6c0317-2671-4770-a722-7b7e1ad020b4 1073741824 Jun 03 12:00:40 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c581d0a0-3f3b-4af7-9dd7-3e0c9dcc305d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:40 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Volume volume-d38057ac-fc20-49ab-acaa-1bfab8773e6b (d38057ac-fc20-49ab-acaa-1bfab8773e6b): created successfully Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c581d0a0-3f3b-4af7-9dd7-3e0c9dcc305d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Flow 'volume_create_manager' (b1ea34e0-ce28-4b95-8584-08e9d60b616b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:40 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-df0786ed-8b4b-484b-9ef2-9c12fa83522a tempest-VolumeTypesAccessTest-767800104 None] Created volume successfully. Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Flow 'volume_create_manager' (9ec3d987-666d-46d0-8471-dfd277e053b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af4fd2b-2b34-4602-981c-2d6be61511f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af4fd2b-2b34-4602-981c-2d6be61511f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1001306290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601bad4b-3030-4bf0-8d1d-85bab4b1768c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee551dc80854918b7177bad04c3e028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:41Z,use_quota=True,user_id='7f3b5dc124ac44a48e60ed46481a3b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1dd7e131-d262-4f78-a32e-899b30241dcd),volume_type_id=1dd7e131-d262-4f78-a32e-899b30241dcd)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4655e06-203d-4417-9d85-2bf1ad75c40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4655e06-203d-4417-9d85-2bf1ad75c40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619e80b5-4880-426f-b40d-d45cc3975697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:40 devstack cinder-volume[86724]: DEBUG cinder.image.glance [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Creating Keystone auth plugin from conf {{(pid=86724) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 03 12:00:41 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619e80b5-4880-426f-b40d-d45cc3975697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '601bad4b-3030-4bf0-8d1d-85bab4b1768c', 'volume_name': 'volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c', 'volume_size': 1, 'image_id': '7683931d-93be-473f-a8f4-c1900265bddc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7683931d-93be-473f-a8f4-c1900265bddc', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--993737912', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bee551dc80854918b7177bad04c3e028', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7683931d-93be-473f-a8f4-c1900265bddc', 'created_at': datetime.datetime(2026, 6, 3, 10, 0, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 10, 0, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7683931d-93be-473f-a8f4-c1900265bddc/file', 'properties': {}}, 'image_service': }' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:41 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb9fb7c-f756-450e-a8c0-6bf4c665e715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:41 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb9fb7c-f756-450e-a8c0-6bf4c665e715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:41 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb77563f-e332-4def-9161-06b53ca38eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:41 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Volume 601bad4b-3030-4bf0-8d1d-85bab4b1768c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c', 'volume_size': 1, 'image_id': '7683931d-93be-473f-a8f4-c1900265bddc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7683931d-93be-473f-a8f4-c1900265bddc', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--993737912', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bee551dc80854918b7177bad04c3e028', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7683931d-93be-473f-a8f4-c1900265bddc', 'created_at': datetime.datetime(2026, 6, 3, 10, 0, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 10, 0, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7683931d-93be-473f-a8f4-c1900265bddc/file', 'properties': {}}, 'image_service': } Jun 03 12:00:41 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Trying to clone 601bad4b-3030-4bf0-8d1d-85bab4b1768c from image 7683931d-93be-473f-a8f4-c1900265bddc at location (None, [{'url': 'file:///opt/stack/data/glance/images/7683931d-93be-473f-a8f4-c1900265bddc', 'metadata': {}}]). {{(pid=86724) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 03 12:00:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] Acquiring lock "cinder-d38057ac-fc20-49ab-acaa-1bfab8773e6b-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:00:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] Lock "cinder-d38057ac-fc20-49ab-acaa-1bfab8773e6b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:00:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] Acquiring lock "cinder-quobyte-d38057ac-fc20-49ab-acaa-1bfab8773e6b" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:00:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] Lock "cinder-quobyte-d38057ac-fc20-49ab-acaa-1bfab8773e6b" acquired by "delete_volume" :: waited 0.032s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:00:41 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3b8184-8455-43f3-855e-d4be24ac85fc]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:00:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d38057ac-fc20-49ab-acaa-1bfab8773e6b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:41 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d38057ac-fc20-49ab-acaa-1bfab8773e6b Jun 03 12:00:41 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:41 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5c6c0317-2671-4770-a722-7b7e1ad020b4 1073741824" returned: 0 in 1.410s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5c6c0317-2671-4770-a722-7b7e1ad020b4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:41 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5c6c0317-2671-4770-a722-7b7e1ad020b4 Jun 03 12:00:41 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:42 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5c6c0317-2671-4770-a722-7b7e1ad020b4" returned: 0 in 0.963s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] <== create_volume: return (2439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:00:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.447s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.202s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2021613919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d827b0-3b70-40e0-a29e-aef847f48b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee551dc80854918b7177bad04c3e028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:39Z,use_quota=True,user_id='7f3b5dc124ac44a48e60ed46481a3b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fe637bc-6b0e-49b0-98ea-bab8d4297fa4),volume_type_id=6fe637bc-6b0e-49b0-98ea-bab8d4297fa4)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:00:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Creating volume 00d827b0-3b70-40e0-a29e-aef847f48b1c {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:00:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:00:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:00:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:00:42 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:00:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-00d827b0-3b70-40e0-a29e-aef847f48b1c 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:42 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-00d827b0-3b70-40e0-a29e-aef847f48b1c 1073741824 Jun 03 12:00:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783f910a-57bc-4ccc-9295-652a7c2dcea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c6c0317-2671-4770-a722-7b7e1ad020b4', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:42 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:42 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef56b85-1a64-4108-9b9c-1335421b57c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d38057ac-fc20-49ab-acaa-1bfab8773e6b" returned: 0 in 1.310s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d38057ac-fc20-49ab-acaa-1bfab8773e6b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:42 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Volume volume-5c6c0317-2671-4770-a722-7b7e1ad020b4 (5c6c0317-2671-4770-a722-7b7e1ad020b4): created successfully Jun 03 12:00:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef56b85-1a64-4108-9b9c-1335421b57c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Flow 'volume_create_manager' (91f3f13a-4779-41d0-a451-98883c00832c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:42 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d38057ac-fc20-49ab-acaa-1bfab8773e6b Jun 03 12:00:42 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:42 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-de8aeb6e-084f-462b-81f1-5b2e95ac33e8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Created volume successfully. Jun 03 12:00:43 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d38057ac-fc20-49ab-acaa-1bfab8773e6b" returned: 0 in 1.068s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:43 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] Lock "cinder-quobyte-d38057ac-fc20-49ab-acaa-1bfab8773e6b" released by "delete_volume" :: held 2.436s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:00:43 devstack cinder-volume[86724]: WARNING cinder.quota [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1063285021 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1063285021, it is now deprecated. Please use the default quota class for default quota. Jun 03 12:00:43 devstack cinder-volume[86724]: WARNING cinder.quota [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1063285021 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1063285021, it is now deprecated. Please use the default quota class for default quota. Jun 03 12:00:44 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] Created reservations ['4b2a46e2-55a6-4445-842a-62144a5926fe', '57da4007-eb73-442b-82d7-b99fc9bdaf8c', '6d346fa9-b22d-44fa-b4d0-1997f7f31421', '9e402aed-0314-4910-bcf3-0e3c7ef08966'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:00:44 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-00d827b0-3b70-40e0-a29e-aef847f48b1c 1073741824" returned: 0 in 1.295s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-00d827b0-3b70-40e0-a29e-aef847f48b1c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:44 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:00:44 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-00d827b0-3b70-40e0-a29e-aef847f48b1c Jun 03 12:00:44 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:00:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:44 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:44 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:00:44 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:45 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-00d827b0-3b70-40e0-a29e-aef847f48b1c" returned: 0 in 0.989s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] <== create_volume: return (2357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:00:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.363s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1d418e-a5b2-4b08-8877-51f9a66e9bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00d827b0-3b70-40e0-a29e-aef847f48b1c', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd922e6-dd2e-450f-9fc0-289483eb3638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:45 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Volume volume-00d827b0-3b70-40e0-a29e-aef847f48b1c (00d827b0-3b70-40e0-a29e-aef847f48b1c): created successfully Jun 03 12:00:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd922e6-dd2e-450f-9fc0-289483eb3638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Flow 'volume_create_manager' (29d2ccaa-46be-4dcb-ae3b-75d56d7d3c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:45 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a1e9b54c-f801-4ef6-b63b-51f9b251adf8 tempest-TestInstancesWithCinderVolumes-1308894972 None] Created volume successfully. Jun 03 12:00:45 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.235s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:45 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:00:45 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] Deleted volume successfully. Jun 03 12:00:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-33181220-1620-4406-8c0f-6138dd3241bc tempest-VolumeTypesAccessTest-767800104 None] Lock "cinder-d38057ac-fc20-49ab-acaa-1bfab8773e6b-delete_volume" released by "delete_volume" :: held 4.043s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:00:46 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7683931d-93be-473f-a8f4-c1900265bddc_hkhj1shtdevstack@QuobyteHD, size 20.69 MB, duration 5.62 sec {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 03 12:00:46 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Image download 20.69 MB at 3.68 MB/s Jun 03 12:00:46 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5305420d-d1e5-437e-8c1a-858ae258cd2e]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:00:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7683931d-93be-473f-a8f4-c1900265bddc_hkhj1shtdevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:46 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7683931d-93be-473f-a8f4-c1900265bddc_hkhj1shtdevstack@QuobyteHD Jun 03 12:00:46 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:47 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7683931d-93be-473f-a8f4-c1900265bddc_hkhj1shtdevstack@QuobyteHD" returned: 0 in 0.998s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:47 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Temporary image 7683931d-93be-473f-a8f4-c1900265bddc is fetched for user 7f3b5dc124ac44a48e60ed46481a3b1c. {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 03 12:00:47 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f09225b-9b48-4cf0-9319-b07bbf127680]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:00:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7683931d-93be-473f-a8f4-c1900265bddc_hkhj1shtdevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:48 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7683931d-93be-473f-a8f4-c1900265bddc_hkhj1shtdevstack@QuobyteHD Jun 03 12:00:48 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:48 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7683931d-93be-473f-a8f4-c1900265bddc_hkhj1shtdevstack@QuobyteHD" returned: 0 in 0.911s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:48 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1001306290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601bad4b-3030-4bf0-8d1d-85bab4b1768c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee551dc80854918b7177bad04c3e028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:41Z,use_quota=True,user_id='7f3b5dc124ac44a48e60ed46481a3b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1dd7e131-d262-4f78-a32e-899b30241dcd),volume_type_id=1dd7e131-d262-4f78-a32e-899b30241dcd)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:00:48 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Creating volume 601bad4b-3030-4bf0-8d1d-85bab4b1768c {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:00:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:48 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:00:48 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:00:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:48 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:00:48 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:00:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:48 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c 1073741824 Jun 03 12:00:48 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:48 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:00:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Flow 'volume_create_manager' (54d22796-a172-4371-8dd1-d825aab02d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d09b03f-69ae-4cca-910b-a0e7b5862959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d09b03f-69ae-4cca-910b-a0e7b5862959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-834690628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744b2840ede14ff7a21ec900dc263149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:49Z,use_quota=True,user_id='11ad7153240341a58cf38998c3bdfc7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058aed4b-df1d-4c9c-ae08-79c399d16425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058aed4b-df1d-4c9c-ae08-79c399d16425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f926cb11-2592-4f8a-9186-b4093d7e2615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:49 devstack cinder-volume[86724]: DEBUG cinder.image.glance [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Creating Keystone auth plugin from conf {{(pid=86724) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 03 12:00:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f926cb11-2592-4f8a-9186-b4093d7e2615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b', 'volume_name': 'volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b', 'volume_size': 1, 'image_id': '0249897e-120c-42bb-b1a8-f517317c1907', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e70522cb7d6245e7970314b42bb711e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0249897e-120c-42bb-b1a8-f517317c1907', 'created_at': datetime.datetime(2026, 6, 3, 9, 43, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 9, 43, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0249897e-120c-42bb-b1a8-f517317c1907/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef0a79fa-95e0-4156-99a5-11f6bec213ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef0a79fa-95e0-4156-99a5-11f6bec213ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c5510c-5c34-4727-86ba-1e466d76c5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:49 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Volume 8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b', 'volume_size': 1, 'image_id': '0249897e-120c-42bb-b1a8-f517317c1907', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e70522cb7d6245e7970314b42bb711e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0249897e-120c-42bb-b1a8-f517317c1907', 'created_at': datetime.datetime(2026, 6, 3, 9, 43, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 9, 43, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0249897e-120c-42bb-b1a8-f517317c1907/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 03 12:00:49 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Trying to clone 8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b from image 0249897e-120c-42bb-b1a8-f517317c1907 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}]). {{(pid=86724) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 03 12:00:49 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c 1073741824" returned: 0 in 1.072s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:50 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c Jun 03 12:00:50 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:50 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_8eoxfk_pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 03 12:00:50 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Image download 20.69 MB at 20.69 MB/s Jun 03 12:00:50 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e915058c-b040-4c1d-bce4-f57aced399a8]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:00:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_8eoxfk_pdevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:50 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_8eoxfk_pdevstack@QuobyteHD Jun 03 12:00:50 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:50 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c" returned: 0 in 0.843s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:50 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:00:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:50 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Attempting download of 7683931d-93be-473f-a8f4-c1900265bddc ((None, [{'url': 'file:///opt/stack/data/glance/images/7683931d-93be-473f-a8f4-c1900265bddc', 'metadata': {}}])) to volume 601bad4b-3030-4bf0-8d1d-85bab4b1768c. {{(pid=86724) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 03 12:00:50 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62d5289-cf44-449c-baeb-6cfe54b3a207]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:00:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7683931d-93be-473f-a8f4-c1900265bddc_dkxpq9t4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:51 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_8eoxfk_pdevstack@QuobyteHD" returned: 0 in 0.901s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:51 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Temporary image 0249897e-120c-42bb-b1a8-f517317c1907 is fetched for user 11ad7153240341a58cf38998c3bdfc7c. {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 03 12:00:51 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7683931d-93be-473f-a8f4-c1900265bddc_dkxpq9t4 Jun 03 12:00:51 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:51 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e363ef-7741-4e36-a46a-c3fe0e7517cc]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:00:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_8eoxfk_pdevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:51 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_8eoxfk_pdevstack@QuobyteHD Jun 03 12:00:51 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:51 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7683931d-93be-473f-a8f4-c1900265bddc_dkxpq9t4" returned: 0 in 1.014s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7683931d-93be-473f-a8f4-c1900265bddc_dkxpq9t4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:52 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_8eoxfk_pdevstack@QuobyteHD" returned: 0 in 0.852s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-834690628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744b2840ede14ff7a21ec900dc263149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:00:49Z,use_quota=True,user_id='11ad7153240341a58cf38998c3bdfc7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:00:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Creating volume 8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:00:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:00:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:00:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:00:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:00:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:00:52 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:00:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:52 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b 1073741824 Jun 03 12:00:52 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:52 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7683931d-93be-473f-a8f4-c1900265bddc_dkxpq9t4 Jun 03 12:00:52 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:52 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7683931d-93be-473f-a8f4-c1900265bddc_dkxpq9t4" returned: 1 in 0.883s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7683931d-93be-473f-a8f4-c1900265bddc_dkxpq9t4' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:00:52 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1fae91-24e5-41dd-a04e-3cc8e392bc96]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:00:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7683931d-93be-473f-a8f4-c1900265bddc_hkhj1shtdevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:53 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7683931d-93be-473f-a8f4-c1900265bddc_hkhj1shtdevstack@QuobyteHD Jun 03 12:00:53 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:53 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b 1073741824" returned: 0 in 1.067s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:53 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b Jun 03 12:00:53 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:53 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7683931d-93be-473f-a8f4-c1900265bddc_hkhj1shtdevstack@QuobyteHD" returned: 0 in 0.846s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:53 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] 7683931d-93be-473f-a8f4-c1900265bddc was qcow2, converting to raw {{(pid=86724) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 03 12:00:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7683931d-93be-473f-a8f4-c1900265bddc_hkhj1shtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:53 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7683931d-93be-473f-a8f4-c1900265bddc_hkhj1shtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c Jun 03 12:00:53 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:54 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b" returned: 0 in 0.968s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:54 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] <== create_volume: return (2091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:00:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.094s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:00:54 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Attempting download of 0249897e-120c-42bb-b1a8-f517317c1907 ((None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}])) to volume 8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b. {{(pid=86724) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 03 12:00:54 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d99e24-3cae-4071-992e-341dc7986edb]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:00:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_dbz1lqq1 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:54 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_dbz1lqq1 Jun 03 12:00:54 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:55 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_dbz1lqq1" returned: 0 in 0.960s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_dbz1lqq1 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:55 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_dbz1lqq1 Jun 03 12:00:55 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:56 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_dbz1lqq1" returned: 1 in 0.901s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_dbz1lqq1' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:00:56 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fbce0f-b1c5-42da-9624-307c51a1e62c]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:00:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_8eoxfk_pdevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:56 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7683931d-93be-473f-a8f4-c1900265bddc_hkhj1shtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c" returned: 0 in 2.499s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:56 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7683931d-93be-473f-a8f4-c1900265bddc_hkhj1shtdevstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 12:00:56 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Converted 112.00 MB image at 44.80 MB/s Jun 03 12:00:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:56 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c 1G Jun 03 12:00:56 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:56 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_8eoxfk_pdevstack@QuobyteHD Jun 03 12:00:56 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:56 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_8eoxfk_pdevstack@QuobyteHD" returned: 0 in 0.830s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:56 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] 0249897e-120c-42bb-b1a8-f517317c1907 was qcow2, converting to raw {{(pid=86724) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 03 12:00:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_8eoxfk_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:57 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_8eoxfk_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b Jun 03 12:00:57 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:57 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c 1G" returned: 0 in 0.843s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:57 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0cb177-688d-46e4-a94d-04c8aa248fb1]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:00:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:57 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c Jun 03 12:00:57 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:58 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c" returned: 0 in 1.222s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:58 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c Jun 03 12:00:58 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:00:59 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c" returned: 1 in 0.965s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:00:59 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Downloaded image 7683931d-93be-473f-a8f4-c1900265bddc ((None, [{'url': 'file:///opt/stack/data/glance/images/7683931d-93be-473f-a8f4-c1900265bddc', 'metadata': {}}])) to volume 601bad4b-3030-4bf0-8d1d-85bab4b1768c successfully. {{(pid=86724) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 03 12:00:59 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Temporary image 7683931d-93be-473f-a8f4-c1900265bddc for user 7f3b5dc124ac44a48e60ed46481a3b1c is deleted. {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 03 12:00:59 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Marking volume 601bad4b-3030-4bf0-8d1d-85bab4b1768c as bootable. {{(pid=86724) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 03 12:00:59 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Copying metadata from image 7683931d-93be-473f-a8f4-c1900265bddc to 601bad4b-3030-4bf0-8d1d-85bab4b1768c. {{(pid=86724) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 03 12:00:59 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Creating volume glance metadata for volume 601bad4b-3030-4bf0-8d1d-85bab4b1768c backed by image 7683931d-93be-473f-a8f4-c1900265bddc with: {'image_id': '7683931d-93be-473f-a8f4-c1900265bddc', 'image_name': 'tempest-scenario-img--993737912', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86724) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 03 12:00:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb77563f-e332-4def-9161-06b53ca38eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c', 'volume_size': 1, 'image_id': '7683931d-93be-473f-a8f4-c1900265bddc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7683931d-93be-473f-a8f4-c1900265bddc', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--993737912', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bee551dc80854918b7177bad04c3e028', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7683931d-93be-473f-a8f4-c1900265bddc', 'created_at': datetime.datetime(2026, 6, 3, 10, 0, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 10, 0, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7683931d-93be-473f-a8f4-c1900265bddc/file', 'properties': {}}, 'image_service': }' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf03da30-3256-4244-9e26-b08de448b581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:00:59 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Volume volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c (601bad4b-3030-4bf0-8d1d-85bab4b1768c): created successfully Jun 03 12:00:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf03da30-3256-4244-9e26-b08de448b581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:00:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Flow 'volume_create_manager' (9ec3d987-666d-46d0-8471-dfd277e053b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:00:59 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-3d8abee5-e905-4c76-a263-20fed1e19450 tempest-TestInstancesWithCinderVolumes-1308894972 None] Created volume successfully. Jun 03 12:00:59 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Jun 03 12:00:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_8eoxfk_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b" returned: 0 in 2.597s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:00:59 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_8eoxfk_pdevstack@QuobyteHD, size 112.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 12:00:59 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Converted 112.00 MB image at 43.10 MB/s Jun 03 12:00:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:00:59 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b 1G Jun 03 12:00:59 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Flow 'volume_create_manager' (87f6bdcf-c49f-48fa-a4c5-0ac1896fa731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad9affc-237b-4c5e-aa8d-8c3d60cbfc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad9affc-237b-4c5e-aa8d-8c3d60cbfc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-966614174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26f510c-feb5-4aad-afa8-49cfc1e7d27a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22ce8d94a7d484eb9fb25af63c108ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:01:00Z,use_quota=True,user_id='bb735d4782d540f8bbdadfe50cd29fa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd0d0b2-ae53-4aa0-b40a-c7db0fb2d8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd0d0b2-ae53-4aa0-b40a-c7db0fb2d8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ddedf84-f199-4a30-ba10-e8f719c346d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ddedf84-f199-4a30-ba10-e8f719c346d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b26f510c-feb5-4aad-afa8-49cfc1e7d27a', 'volume_name': 'volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e59eca5-aa59-4868-9fc3-79448aa6b72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e59eca5-aa59-4868-9fc3-79448aa6b72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7ddcd7-c56e-4708-b5fb-5e4dafcd3309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:00 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Volume b26f510c-feb5-4aad-afa8-49cfc1e7d27a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a', 'volume_size': 1} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-966614174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26f510c-feb5-4aad-afa8-49cfc1e7d27a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22ce8d94a7d484eb9fb25af63c108ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:01:00Z,use_quota=True,user_id='bb735d4782d540f8bbdadfe50cd29fa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Creating volume b26f510c-feb5-4aad-afa8-49cfc1e7d27a {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:01:00 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:00 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a 1073741824 Jun 03 12:01:00 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:00 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b 1G" returned: 0 in 0.993s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee84652-aa6c-4be2-b631-9700c71bf03d]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:01:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:00 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b Jun 03 12:01:00 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:01 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a 1073741824" returned: 0 in 0.992s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:01 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a Jun 03 12:01:01 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:01 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b" returned: 0 in 1.071s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:01 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b Jun 03 12:01:01 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:02 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a" returned: 0 in 0.752s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7ddcd7-c56e-4708-b5fb-5e4dafcd3309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c9b836-41d1-4298-8208-6ee0f7ea0477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:02 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Volume volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a (b26f510c-feb5-4aad-afa8-49cfc1e7d27a): created successfully Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c9b836-41d1-4298-8208-6ee0f7ea0477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Flow 'volume_create_manager' (87f6bdcf-c49f-48fa-a4c5-0ac1896fa731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:01:02 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-4aa5eac4-4138-484d-9e43-21a090c1a056 tempest-VolumesDeleteCascade-80362656 None] Created volume successfully. Jun 03 12:01:02 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b" returned: 1 in 1.070s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Downloaded image 0249897e-120c-42bb-b1a8-f517317c1907 ((None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}])) to volume 8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b successfully. {{(pid=86724) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Temporary image 0249897e-120c-42bb-b1a8-f517317c1907 for user 11ad7153240341a58cf38998c3bdfc7c is deleted. {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Marking volume 8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b as bootable. {{(pid=86724) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Copying metadata from image 0249897e-120c-42bb-b1a8-f517317c1907 to 8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b. {{(pid=86724) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Creating volume glance metadata for volume 8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b backed by image 0249897e-120c-42bb-b1a8-f517317c1907 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0249897e-120c-42bb-b1a8-f517317c1907', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86724) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b12b10c6-ffb1-4f0e-ac74-23f6590cc9d3 tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b12b10c6-ffb1-4f0e-ac74-23f6590cc9d3 tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-b12b10c6-ffb1-4f0e-ac74-23f6590cc9d3 tempest-VolumesDeleteCascade-80362656 None] Creating offline snapshot 506178cd-fe3b-4de5-8512-b4ca250d7dd0 of volume b26f510c-feb5-4aad-afa8-49cfc1e7d27a {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c5510c-5c34-4727-86ba-1e466d76c5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b', 'volume_size': 1, 'image_id': '0249897e-120c-42bb-b1a8-f517317c1907', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e70522cb7d6245e7970314b42bb711e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0249897e-120c-42bb-b1a8-f517317c1907', 'created_at': datetime.datetime(2026, 6, 3, 9, 43, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 9, 43, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0249897e-120c-42bb-b1a8-f517317c1907/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ef998a-ab85-4b39-98ea-97576b7657b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc8893a-4651-4113-aa7b-92ff49d77004]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b12b10c6-ffb1-4f0e-ac74-23f6590cc9d3 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:02 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Volume volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b (8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b): created successfully Jun 03 12:01:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ef998a-ab85-4b39-98ea-97576b7657b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:03 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Flow 'volume_create_manager' (54d22796-a172-4371-8dd1-d825aab02d86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:01:03 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-1d96ff8a-79bf-4a33-b375-661c865278b7 tempest-VolumesImageMetadata-1060551080 None] Created volume successfully. Jun 03 12:01:03 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a Jun 03 12:01:03 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] Acquiring lock "cinder-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:01:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] Lock "cinder-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:01:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] Acquiring lock "cinder-quobyte-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:01:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] Lock "cinder-quobyte-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b" acquired by "delete_volume" :: waited 0.033s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:01:03 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b12b10c6-ffb1-4f0e-ac74-23f6590cc9d3 tempest-VolumesDeleteCascade-80362656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a" returned: 0 in 0.993s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b12b10c6-ffb1-4f0e-ac74-23f6590cc9d3 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:03 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 1G Jun 03 12:01:03 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:03 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded91ace-f09e-40d8-8dfe-91af2a5ee3e9]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:01:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:04 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b Jun 03 12:01:04 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:04 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b" returned: 0 in 0.902s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:04 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b12b10c6-ffb1-4f0e-ac74-23f6590cc9d3 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 1G" returned: 0 in 0.990s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b12b10c6-ffb1-4f0e-ac74-23f6590cc9d3 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:04 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 Jun 03 12:01:05 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:05 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b Jun 03 12:01:05 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:05 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b" returned: 1 in 0.876s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:01:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:05 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b12b10c6-ffb1-4f0e-ac74-23f6590cc9d3 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0" returned: 0 in 0.843s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:05 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-b12b10c6-ffb1-4f0e-ac74-23f6590cc9d3 tempest-VolumesDeleteCascade-80362656 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 is being set with open permissions: ugo+rw Jun 03 12:01:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b12b10c6-ffb1-4f0e-ac74-23f6590cc9d3 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:05 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b Jun 03 12:01:05 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:05 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 Jun 03 12:01:05 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:06 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b12b10c6-ffb1-4f0e-ac74-23f6590cc9d3 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0" returned: 0 in 0.669s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:06 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b" returned: 0 in 0.734s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b12b10c6-ffb1-4f0e-ac74-23f6590cc9d3 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:06 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] Lock "cinder-quobyte-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b" released by "delete_volume" :: held 2.611s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:01:06 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.info Jun 03 12:01:06 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:06 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] Created reservations ['d3bd49f6-1d6c-4b32-8aad-c08dc55c29d4', 'f18bafc5-3b99-4ebc-b599-f9c09da81bbf', '35cded68-db8b-4024-b497-be3e1345ccbc', 'd200f19e-c9ff-4504-8863-e95cacbae387'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:01:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:01:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:01:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:06 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:01:06 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:07 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b12b10c6-ffb1-4f0e-ac74-23f6590cc9d3 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.info" returned: 0 in 0.950s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:07 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-b12b10c6-ffb1-4f0e-ac74-23f6590cc9d3 tempest-VolumesDeleteCascade-80362656 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.info is being set with open permissions: ugo+rw Jun 03 12:01:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b12b10c6-ffb1-4f0e-ac74-23f6590cc9d3 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:07 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.info Jun 03 12:01:07 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:07 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.877s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:07 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:01:07 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] Deleted volume successfully. Jun 03 12:01:07 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-adc2c717-c04d-4d06-80d2-9746aafb7993 tempest-VolumesImageMetadata-1060551080 None] Lock "cinder-8f3fdbf0-3efb-4f4b-8ec0-20bc36c3ac3b-delete_volume" released by "delete_volume" :: held 3.767s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:01:08 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b12b10c6-ffb1-4f0e-ac74-23f6590cc9d3 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.info" returned: 0 in 0.955s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b12b10c6-ffb1-4f0e-ac74-23f6590cc9d3 tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.550s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:08 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-b12b10c6-ffb1-4f0e-ac74-23f6590cc9d3 tempest-VolumesDeleteCascade-80362656 None] Create snapshot completed successfully Jun 03 12:01:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-ca5511e1-3b62-4ef0-b762-c57521ca023e req-39c81e98-0298-4f50-9b9e-c75f8e51f2e9 tempest-TestInstancesWithCinderVolumes-1308894972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-ca5511e1-3b62-4ef0-b762-c57521ca023e req-39c81e98-0298-4f50-9b9e-c75f8e51f2e9 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:09 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f08e317-ba9f-44cd-a6dd-3e730203342e]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:01:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-ca5511e1-3b62-4ef0-b762-c57521ca023e req-39c81e98-0298-4f50-9b9e-c75f8e51f2e9 tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:09 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c Jun 03 12:01:09 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c499ddb9-61db-4b21-a22d-c67a67b9521c tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:10 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-ca5511e1-3b62-4ef0-b762-c57521ca023e req-39c81e98-0298-4f50-9b9e-c75f8e51f2e9 tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c" returned: 0 in 1.176s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-ca5511e1-3b62-4ef0-b762-c57521ca023e req-39c81e98-0298-4f50-9b9e-c75f8e51f2e9 tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:10 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c Jun 03 12:01:10 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:11 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-ca5511e1-3b62-4ef0-b762-c57521ca023e req-39c81e98-0298-4f50-9b9e-c75f8e51f2e9 tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c" returned: 1 in 0.935s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-ca5511e1-3b62-4ef0-b762-c57521ca023e req-39c81e98-0298-4f50-9b9e-c75f8e51f2e9 tempest-TestInstancesWithCinderVolumes-1308894972 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:01:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-ca5511e1-3b62-4ef0-b762-c57521ca023e req-39c81e98-0298-4f50-9b9e-c75f8e51f2e9 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.181s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c499ddb9-61db-4b21-a22d-c67a67b9521c tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.714s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-c499ddb9-61db-4b21-a22d-c67a67b9521c tempest-VolumesDeleteCascade-80362656 None] Creating offline snapshot 408bfebc-afdc-4332-b7cf-b43afc3c0f58 of volume b26f510c-feb5-4aad-afa8-49cfc1e7d27a {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 12:01:11 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[321d123e-085b-4ff8-a10a-760b73f83dcc]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:01:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c499ddb9-61db-4b21-a22d-c67a67b9521c tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-ca5511e1-3b62-4ef0-b762-c57521ca023e req-39c81e98-0298-4f50-9b9e-c75f8e51f2e9 tempest-TestInstancesWithCinderVolumes-1308894972 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68eca39b-23e5-4df6-b2e2-c5ede8288ed5', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 12:01:11 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-ca5511e1-3b62-4ef0-b762-c57521ca023e req-39c81e98-0298-4f50-9b9e-c75f8e51f2e9 tempest-TestInstancesWithCinderVolumes-1308894972 None] attachment_update completed successfully. Jun 03 12:01:11 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 Jun 03 12:01:11 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:12 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c499ddb9-61db-4b21-a22d-c67a67b9521c tempest-VolumesDeleteCascade-80362656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0" returned: 0 in 0.854s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:12 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-c499ddb9-61db-4b21-a22d-c67a67b9521c tempest-VolumesDeleteCascade-80362656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:01:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c499ddb9-61db-4b21-a22d-c67a67b9521c tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.408bfebc-afdc-4332-b7cf-b43afc3c0f58 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:12 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.408bfebc-afdc-4332-b7cf-b43afc3c0f58 1G Jun 03 12:01:12 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:13 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c499ddb9-61db-4b21-a22d-c67a67b9521c tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.408bfebc-afdc-4332-b7cf-b43afc3c0f58 1G" returned: 0 in 1.365s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c499ddb9-61db-4b21-a22d-c67a67b9521c tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.408bfebc-afdc-4332-b7cf-b43afc3c0f58 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:13 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.408bfebc-afdc-4332-b7cf-b43afc3c0f58 Jun 03 12:01:13 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:13 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:01:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Flow 'volume_create_manager' (14dbd5c6-9be5-473e-890b-b2c5ecc42c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:01:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3677144-b118-4b90-b1d6-2ba4cc1e3699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3677144-b118-4b90-b1d6-2ba4cc1e3699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1893807185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe8422c-f353-4592-86ee-9a04e0f3f059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0669cea818314bb4bc11151c060a36db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:01:14Z,use_quota=True,user_id='94ff656e9d124645b748d9a98614af4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e739cb-cc45-4e15-9c30-382fa6ced42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e739cb-cc45-4e15-9c30-382fa6ced42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275d689a-adc5-4aaa-b4d5-6130a6f3cf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275d689a-adc5-4aaa-b4d5-6130a6f3cf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afe8422c-f353-4592-86ee-9a04e0f3f059', 'volume_name': 'volume-afe8422c-f353-4592-86ee-9a04e0f3f059', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109e9b1b-a425-4b41-b2c0-c2ee5a671312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109e9b1b-a425-4b41-b2c0-c2ee5a671312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368820fa-d66a-4e76-a267-9751b4a7895f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:13 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Volume afe8422c-f353-4592-86ee-9a04e0f3f059: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afe8422c-f353-4592-86ee-9a04e0f3f059', 'volume_size': 1} Jun 03 12:01:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:14 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c499ddb9-61db-4b21-a22d-c67a67b9521c tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.408bfebc-afdc-4332-b7cf-b43afc3c0f58" returned: 0 in 0.705s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:14 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-c499ddb9-61db-4b21-a22d-c67a67b9521c tempest-VolumesDeleteCascade-80362656 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.408bfebc-afdc-4332-b7cf-b43afc3c0f58 is being set with open permissions: ugo+rw Jun 03 12:01:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c499ddb9-61db-4b21-a22d-c67a67b9521c tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.408bfebc-afdc-4332-b7cf-b43afc3c0f58 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:14 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.408bfebc-afdc-4332-b7cf-b43afc3c0f58 Jun 03 12:01:14 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c499ddb9-61db-4b21-a22d-c67a67b9521c tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.408bfebc-afdc-4332-b7cf-b43afc3c0f58" returned: 0 in 0.607s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:15 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c499ddb9-61db-4b21-a22d-c67a67b9521c tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.694s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.191s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1893807185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe8422c-f353-4592-86ee-9a04e0f3f059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0669cea818314bb4bc11151c060a36db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:01:14Z,use_quota=True,user_id='94ff656e9d124645b748d9a98614af4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:01:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Creating volume afe8422c-f353-4592-86ee-9a04e0f3f059 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:01:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:01:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:01:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:01:15 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:01:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-afe8422c-f353-4592-86ee-9a04e0f3f059 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:15 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-afe8422c-f353-4592-86ee-9a04e0f3f059 1073741824 Jun 03 12:01:15 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:15 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c499ddb9-61db-4b21-a22d-c67a67b9521c tempest-VolumesDeleteCascade-80362656 None] Create snapshot completed successfully Jun 03 12:01:15 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-afe8422c-f353-4592-86ee-9a04e0f3f059 1073741824" returned: 0 in 0.807s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-afe8422c-f353-4592-86ee-9a04e0f3f059 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:16 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-afe8422c-f353-4592-86ee-9a04e0f3f059 Jun 03 12:01:16 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "cinder-b26f510c-feb5-4aad-afa8-49cfc1e7d27a-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:01:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-b26f510c-feb5-4aad-afa8-49cfc1e7d27a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:01:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Performing cascade delete. {{(pid=86724) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 03 12:01:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "cinder-408bfebc-afdc-4332-b7cf-b43afc3c0f58-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:01:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-408bfebc-afdc-4332-b7cf-b43afc3c0f58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:01:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "cinder-quobyte-b26f510c-feb5-4aad-afa8-49cfc1e7d27a" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:01:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-b26f510c-feb5-4aad-afa8-49cfc1e7d27a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:01:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "cinder-quobyte-408bfebc-afdc-4332-b7cf-b43afc3c0f58" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:01:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-408bfebc-afdc-4332-b7cf-b43afc3c0f58" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:01:16 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Deleting offline snapshot 408bfebc-afdc-4332-b7cf-b43afc3c0f58 of volume b26f510c-feb5-4aad-afa8-49cfc1e7d27a {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 12:01:16 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] snapshot_file for this snap is: volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.408bfebc-afdc-4332-b7cf-b43afc3c0f58 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 12:01:16 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc78ebf-8b3e-48d0-b7e3-700a1a7cb146]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:01:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.408bfebc-afdc-4332-b7cf-b43afc3c0f58 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:16 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.408bfebc-afdc-4332-b7cf-b43afc3c0f58 Jun 03 12:01:16 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:16 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-afe8422c-f353-4592-86ee-9a04e0f3f059" returned: 0 in 0.850s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:16 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:01:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368820fa-d66a-4e76-a267-9751b4a7895f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afe8422c-f353-4592-86ee-9a04e0f3f059', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8667de4-d35a-4473-b4d5-a1a17b8c6894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:16 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Volume volume-afe8422c-f353-4592-86ee-9a04e0f3f059 (afe8422c-f353-4592-86ee-9a04e0f3f059): created successfully Jun 03 12:01:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8667de4-d35a-4473-b4d5-a1a17b8c6894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Flow 'volume_create_manager' (14dbd5c6-9be5-473e-890b-b2c5ecc42c6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:01:17 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-f52f81a5-0a09-40a0-ab12-4f38561fb8ac tempest-VolumesTransfersV355Test-1816949793 None] Created volume successfully. Jun 03 12:01:17 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.408bfebc-afdc-4332-b7cf-b43afc3c0f58" returned: 0 in 1.177s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:01:17 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[701a5a50-be63-4f9a-b6ae-043c44e7bd8e]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:01:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:17 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 Jun 03 12:01:17 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:18 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0" returned: 0 in 1.203s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:01:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.408bfebc-afdc-4332-b7cf-b43afc3c0f58 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:18 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.408bfebc-afdc-4332-b7cf-b43afc3c0f58 Jun 03 12:01:18 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:20 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=71,cinder:INSERT=30,cinder:UPDATE=75,cinder:DELETE=8 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:01:20 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-6509b1ca-655d-4d86-a8de-460b5448c61d tempest-VolumesTransfersV355Test-305339767 None] Transfer volume completed successfully. Jun 03 12:01:20 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.408bfebc-afdc-4332-b7cf-b43afc3c0f58" returned: 0 in 1.654s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.408bfebc-afdc-4332-b7cf-b43afc3c0f58 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:20 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.408bfebc-afdc-4332-b7cf-b43afc3c0f58 Jun 03 12:01:20 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:21 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e5bb3cb3-276c-4abf-98c6-1fe45d061091 tempest-VolumesTransfersV355Test-1743573117 None] Acquiring lock "cinder-afe8422c-f353-4592-86ee-9a04e0f3f059-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:01:21 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e5bb3cb3-276c-4abf-98c6-1fe45d061091 tempest-VolumesTransfersV355Test-1743573117 None] Lock "cinder-afe8422c-f353-4592-86ee-9a04e0f3f059-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:01:21 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=80,cinder:UPDATE=80,cinder:INSERT=26,cinder:DELETE=8 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:01:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e5bb3cb3-276c-4abf-98c6-1fe45d061091 tempest-VolumesTransfersV355Test-1743573117 None] Acquiring lock "cinder-quobyte-afe8422c-f353-4592-86ee-9a04e0f3f059" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:01:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e5bb3cb3-276c-4abf-98c6-1fe45d061091 tempest-VolumesTransfersV355Test-1743573117 None] Lock "cinder-quobyte-afe8422c-f353-4592-86ee-9a04e0f3f059" acquired by "delete_volume" :: waited 0.043s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:01:22 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eefc13-3652-41f7-8eac-7211219620c8]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:01:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e5bb3cb3-276c-4abf-98c6-1fe45d061091 tempest-VolumesTransfersV355Test-1743573117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-afe8422c-f353-4592-86ee-9a04e0f3f059 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:22 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.408bfebc-afdc-4332-b7cf-b43afc3c0f58" returned: 0 in 1.930s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-408bfebc-afdc-4332-b7cf-b43afc3c0f58" released by "_delete_snapshot" :: held 6.162s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:01:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-b26f510c-feb5-4aad-afa8-49cfc1e7d27a" released by "delete_snapshot" :: held 6.207s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:01:22 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-afe8422c-f353-4592-86ee-9a04e0f3f059 Jun 03 12:01:22 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:22 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Created reservations ['05d4ac4c-4895-4d00-9590-0bbb31a6b7c8', '8802cec9-de6f-4aa8-a98c-627c3b7701e1', '9f5b1442-88b5-41ef-b8f7-5611afc8b76d', 'be41ead0-6cd8-4531-a67d-dbad1670b295'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:01:22 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Delete snapshot completed successfully. Jun 03 12:01:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-408bfebc-afdc-4332-b7cf-b43afc3c0f58-delete_snapshot" released by "delete_snapshot" :: held 6.788s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:01:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "cinder-506178cd-fe3b-4de5-8512-b4ca250d7dd0-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:01:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-506178cd-fe3b-4de5-8512-b4ca250d7dd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:01:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "cinder-quobyte-b26f510c-feb5-4aad-afa8-49cfc1e7d27a" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:01:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-b26f510c-feb5-4aad-afa8-49cfc1e7d27a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:01:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "cinder-quobyte-506178cd-fe3b-4de5-8512-b4ca250d7dd0" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:01:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-506178cd-fe3b-4de5-8512-b4ca250d7dd0" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:01:23 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Deleting offline snapshot 506178cd-fe3b-4de5-8512-b4ca250d7dd0 of volume b26f510c-feb5-4aad-afa8-49cfc1e7d27a {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 12:01:23 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] snapshot_file for this snap is: volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 12:01:23 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcd8cb0-cad4-4737-8a55-742dbb0197a8]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:01:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:23 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 Jun 03 12:01:23 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:23 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e5bb3cb3-276c-4abf-98c6-1fe45d061091 tempest-VolumesTransfersV355Test-1743573117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-afe8422c-f353-4592-86ee-9a04e0f3f059" returned: 0 in 1.596s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e5bb3cb3-276c-4abf-98c6-1fe45d061091 tempest-VolumesTransfersV355Test-1743573117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-afe8422c-f353-4592-86ee-9a04e0f3f059 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:23 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-afe8422c-f353-4592-86ee-9a04e0f3f059 Jun 03 12:01:23 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:24 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0" returned: 0 in 1.460s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:01:24 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed236de1-0ab9-4439-ac68-0672f7559978]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:01:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:24 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e5bb3cb3-276c-4abf-98c6-1fe45d061091 tempest-VolumesTransfersV355Test-1743573117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-afe8422c-f353-4592-86ee-9a04e0f3f059" returned: 0 in 1.056s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e5bb3cb3-276c-4abf-98c6-1fe45d061091 tempest-VolumesTransfersV355Test-1743573117 None] Lock "cinder-quobyte-afe8422c-f353-4592-86ee-9a04e0f3f059" released by "delete_volume" :: held 2.755s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:01:24 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a Jun 03 12:01:24 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:24 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-e5bb3cb3-276c-4abf-98c6-1fe45d061091 tempest-VolumesTransfersV355Test-1743573117 None] Created reservations ['3cb087f7-65dd-40ed-958f-9001be06c357', '2d2cfbaa-c893-4f11-bf9c-8033c4240b68', '50e1e3da-bd2e-4063-a25b-e3691c12d28b', '08210fc7-6b44-44eb-9a80-0045e439de7c'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:01:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e5bb3cb3-276c-4abf-98c6-1fe45d061091 tempest-VolumesTransfersV355Test-1743573117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e5bb3cb3-276c-4abf-98c6-1fe45d061091 tempest-VolumesTransfersV355Test-1743573117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:25 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e5bb3cb3-276c-4abf-98c6-1fe45d061091 tempest-VolumesTransfersV355Test-1743573117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:01:25 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e5bb3cb3-276c-4abf-98c6-1fe45d061091 tempest-VolumesTransfersV355Test-1743573117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:01:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e5bb3cb3-276c-4abf-98c6-1fe45d061091 tempest-VolumesTransfersV355Test-1743573117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e5bb3cb3-276c-4abf-98c6-1fe45d061091 tempest-VolumesTransfersV355Test-1743573117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:25 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:01:25 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Flow 'volume_create_manager' (27d0f400-a878-4a2d-ad48-a3d6d73ab061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a2874d-6c01-44d8-8a8b-9eea14ffa2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a2874d-6c01-44d8-8a8b-9eea14ffa2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-374637898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d752d4c3-1a74-4871-abe2-503b8390d280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0669cea818314bb4bc11151c060a36db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:01:26Z,use_quota=True,user_id='94ff656e9d124645b748d9a98614af4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:26 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd9f0ef-dca1-419e-8e46-d9615e75ac22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd9f0ef-dca1-419e-8e46-d9615e75ac22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ddf123-9ce5-4d39-aa00-339d7d589171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ddf123-9ce5-4d39-aa00-339d7d589171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd752d4c3-1a74-4871-abe2-503b8390d280', 'volume_name': 'volume-d752d4c3-1a74-4871-abe2-503b8390d280', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7d4997-6178-4fc3-a19f-5102757929a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7d4997-6178-4fc3-a19f-5102757929a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f0b959-01ba-4427-adfe-dc84e158face) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:26 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Volume d752d4c3-1a74-4871-abe2-503b8390d280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d752d4c3-1a74-4871-abe2-503b8390d280', 'volume_size': 1} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-374637898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d752d4c3-1a74-4871-abe2-503b8390d280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0669cea818314bb4bc11151c060a36db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:01:26Z,use_quota=True,user_id='94ff656e9d124645b748d9a98614af4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Creating volume d752d4c3-1a74-4871-abe2-503b8390d280 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:01:26 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d752d4c3-1a74-4871-abe2-503b8390d280 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a" returned: 0 in 1.951s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:26 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e5bb3cb3-276c-4abf-98c6-1fe45d061091 tempest-VolumesTransfersV355Test-1743573117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.661s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-e5bb3cb3-276c-4abf-98c6-1fe45d061091 tempest-VolumesTransfersV355Test-1743573117 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:01:26 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d752d4c3-1a74-4871-abe2-503b8390d280 1073741824 Jun 03 12:01:26 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:26 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-e5bb3cb3-276c-4abf-98c6-1fe45d061091 tempest-VolumesTransfersV355Test-1743573117 None] Deleted volume successfully. Jun 03 12:01:26 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 Jun 03 12:01:26 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e5bb3cb3-276c-4abf-98c6-1fe45d061091 tempest-VolumesTransfersV355Test-1743573117 None] Lock "cinder-afe8422c-f353-4592-86ee-9a04e0f3f059-delete_volume" released by "delete_volume" :: held 4.911s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:01:27 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0" returned: 0 in 1.228s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:27 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0 Jun 03 12:01:27 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:28 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d752d4c3-1a74-4871-abe2-503b8390d280 1073741824" returned: 0 in 1.460s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d752d4c3-1a74-4871-abe2-503b8390d280 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:28 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d752d4c3-1a74-4871-abe2-503b8390d280 Jun 03 12:01:28 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:29 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a.506178cd-fe3b-4de5-8512-b4ca250d7dd0" returned: 0 in 1.642s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:29 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-506178cd-fe3b-4de5-8512-b4ca250d7dd0" released by "_delete_snapshot" :: held 6.547s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:01:29 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-b26f510c-feb5-4aad-afa8-49cfc1e7d27a" released by "delete_snapshot" :: held 6.623s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:01:29 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d752d4c3-1a74-4871-abe2-503b8390d280" returned: 0 in 1.552s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:29 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] <== create_volume: return (3105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:01:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.107s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f0b959-01ba-4427-adfe-dc84e158face) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d752d4c3-1a74-4871-abe2-503b8390d280', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03be5b0a-00bb-475a-ba8f-92d90829750b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:29 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Volume volume-d752d4c3-1a74-4871-abe2-503b8390d280 (d752d4c3-1a74-4871-abe2-503b8390d280): created successfully Jun 03 12:01:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03be5b0a-00bb-475a-ba8f-92d90829750b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Flow 'volume_create_manager' (27d0f400-a878-4a2d-ad48-a3d6d73ab061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:01:29 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-34babec8-0a0e-4bce-b7c6-36028c3cc968 tempest-VolumesTransfersV355Test-1816949793 None] Created volume successfully. Jun 03 12:01:30 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Created reservations ['5c32083c-549d-4761-b522-b049c37e5bf4', '83f31710-e969-4d24-970a-c9f02de70bfe', '7d453555-c1d0-44d5-8196-8842fa3229b1', '3f93fc46-b748-4885-9f19-e0ac8d0e4efe'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:01:30 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Delete snapshot completed successfully. Jun 03 12:01:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-506178cd-fe3b-4de5-8512-b4ca250d7dd0-delete_snapshot" released by "delete_snapshot" :: held 7.177s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:01:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Snapshots deleted, issuing volume delete {{(pid=86724) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 03 12:01:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "cinder-quobyte-b26f510c-feb5-4aad-afa8-49cfc1e7d27a" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:01:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-b26f510c-feb5-4aad-afa8-49cfc1e7d27a" acquired by "delete_volume" :: waited 0.037s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:01:30 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f083e60c-ca89-4170-9ec8-f5ec556bd681]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:01:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:30 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a Jun 03 12:01:30 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:31 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e2fc4faa-0a05-4ef3-9927-b949c0f0f9c7 tempest-VolumesTransfersV355Test-1743573117 None] Acquiring lock "cinder-d752d4c3-1a74-4871-abe2-503b8390d280-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:01:31 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e2fc4faa-0a05-4ef3-9927-b949c0f0f9c7 tempest-VolumesTransfersV355Test-1743573117 None] Lock "cinder-d752d4c3-1a74-4871-abe2-503b8390d280-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:01:31 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e2fc4faa-0a05-4ef3-9927-b949c0f0f9c7 tempest-VolumesTransfersV355Test-1743573117 None] Acquiring lock "cinder-quobyte-d752d4c3-1a74-4871-abe2-503b8390d280" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:01:31 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e2fc4faa-0a05-4ef3-9927-b949c0f0f9c7 tempest-VolumesTransfersV355Test-1743573117 None] Lock "cinder-quobyte-d752d4c3-1a74-4871-abe2-503b8390d280" acquired by "delete_volume" :: waited 0.042s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:01:31 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ff267c-9ee4-4114-91e2-9e2c99eb7041]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:01:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e2fc4faa-0a05-4ef3-9927-b949c0f0f9c7 tempest-VolumesTransfersV355Test-1743573117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d752d4c3-1a74-4871-abe2-503b8390d280 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:32 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a" returned: 0 in 1.746s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:32 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a Jun 03 12:01:32 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:32 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d752d4c3-1a74-4871-abe2-503b8390d280 Jun 03 12:01:32 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:33 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b26f510c-feb5-4aad-afa8-49cfc1e7d27a" returned: 0 in 1.118s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:33 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-b26f510c-feb5-4aad-afa8-49cfc1e7d27a" released by "delete_volume" :: held 3.058s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:01:33 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Created reservations ['d3820247-5a61-4277-9d43-3b6a5554ed30', 'e3aec232-ec92-4402-8b43-cd943e7fdff3', 'f522b0d7-7914-4d65-9f71-801e1356bc0f', 'e8d739cb-7dc5-4f31-8338-4bc7c8367fed'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:01:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:33 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:01:33 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:01:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:33 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:01:33 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:33 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e2fc4faa-0a05-4ef3-9927-b949c0f0f9c7 tempest-VolumesTransfersV355Test-1743573117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d752d4c3-1a74-4871-abe2-503b8390d280" returned: 0 in 1.677s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e2fc4faa-0a05-4ef3-9927-b949c0f0f9c7 tempest-VolumesTransfersV355Test-1743573117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d752d4c3-1a74-4871-abe2-503b8390d280 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:33 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d752d4c3-1a74-4871-abe2-503b8390d280 Jun 03 12:01:33 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:34 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e2fc4faa-0a05-4ef3-9927-b949c0f0f9c7 tempest-VolumesTransfersV355Test-1743573117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d752d4c3-1a74-4871-abe2-503b8390d280" returned: 0 in 1.033s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e2fc4faa-0a05-4ef3-9927-b949c0f0f9c7 tempest-VolumesTransfersV355Test-1743573117 None] Lock "cinder-quobyte-d752d4c3-1a74-4871-abe2-503b8390d280" released by "delete_volume" :: held 2.803s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:01:34 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-e2fc4faa-0a05-4ef3-9927-b949c0f0f9c7 tempest-VolumesTransfersV355Test-1743573117 None] Created reservations ['3ec041b0-2c6a-404f-9f06-cd7b2fc897ac', '237d3b2c-ff4d-48be-b114-70dcf1db9642', 'c5d59d43-8ccc-407b-a48b-c5479ac64f7d', '70cb5685-e467-47b4-9641-568a6cca31a0'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:01:35 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e2fc4faa-0a05-4ef3-9927-b949c0f0f9c7 tempest-VolumesTransfersV355Test-1743573117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e2fc4faa-0a05-4ef3-9927-b949c0f0f9c7 tempest-VolumesTransfersV355Test-1743573117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:35 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e2fc4faa-0a05-4ef3-9927-b949c0f0f9c7 tempest-VolumesTransfersV355Test-1743573117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:01:35 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e2fc4faa-0a05-4ef3-9927-b949c0f0f9c7 tempest-VolumesTransfersV355Test-1743573117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:01:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e2fc4faa-0a05-4ef3-9927-b949c0f0f9c7 tempest-VolumesTransfersV355Test-1743573117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e2fc4faa-0a05-4ef3-9927-b949c0f0f9c7 tempest-VolumesTransfersV355Test-1743573117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.493s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:35 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:01:35 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Deleted volume successfully. Jun 03 12:01:35 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5217d7a3-2483-4f9a-8f12-13e8f76b0dd0 tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-b26f510c-feb5-4aad-afa8-49cfc1e7d27a-delete_volume" released by "delete_volume" :: held 19.070s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:01:35 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:01:35 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Flow 'volume_create_manager' (e654f55f-95a9-42da-957f-8127ecf5dde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44f6e19-4497-43f0-801f-d7049f06a419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:36 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e2fc4faa-0a05-4ef3-9927-b949c0f0f9c7 tempest-VolumesTransfersV355Test-1743573117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.630s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-e2fc4faa-0a05-4ef3-9927-b949c0f0f9c7 tempest-VolumesTransfersV355Test-1743573117 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:01:36 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-e2fc4faa-0a05-4ef3-9927-b949c0f0f9c7 tempest-VolumesTransfersV355Test-1743573117 None] Deleted volume successfully. Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44f6e19-4497-43f0-801f-d7049f06a419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1814677888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=997c86a2-9113-4b39-856b-ba09054d5b53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22ce8d94a7d484eb9fb25af63c108ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:01:36Z,use_quota=True,user_id='bb735d4782d540f8bbdadfe50cd29fa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ce0468-61ba-46b3-b836-44235f8b9499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ce0468-61ba-46b3-b836-44235f8b9499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07dd60f0-2186-48f2-896a-27991cef3feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07dd60f0-2186-48f2-896a-27991cef3feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '997c86a2-9113-4b39-856b-ba09054d5b53', 'volume_name': 'volume-997c86a2-9113-4b39-856b-ba09054d5b53', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe3a862-51ca-4577-9f8f-d94c98ef34b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe3a862-51ca-4577-9f8f-d94c98ef34b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a82f5d-b3b2-44ac-8b33-c80edc006fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:36 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Volume 997c86a2-9113-4b39-856b-ba09054d5b53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-997c86a2-9113-4b39-856b-ba09054d5b53', 'volume_size': 1} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1814677888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=997c86a2-9113-4b39-856b-ba09054d5b53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22ce8d94a7d484eb9fb25af63c108ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:01:36Z,use_quota=True,user_id='bb735d4782d540f8bbdadfe50cd29fa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Creating volume 997c86a2-9113-4b39-856b-ba09054d5b53 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:01:36 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:36 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53 1073741824 Jun 03 12:01:36 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:37 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:01:37 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e2fc4faa-0a05-4ef3-9927-b949c0f0f9c7 tempest-VolumesTransfersV355Test-1743573117 None] Lock "cinder-d752d4c3-1a74-4871-abe2-503b8390d280-delete_volume" released by "delete_volume" :: held 5.292s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:01:37 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:37 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:01:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Flow 'volume_create_manager' (8f509cbc-899a-4efe-91dd-75591d837ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:01:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f7b3c8-0e9c-4d08-8687-3690e7fcc258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f7b3c8-0e9c-4d08-8687-3690e7fcc258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-987253394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0be97ad-fbe8-4111-b6ac-74b919ec683c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82a9f65922a4562abab77e856caeacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:01:37Z,use_quota=True,user_id='b0230be3367a489aab1de137363444a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (805b8f42-961c-474c-a040-56008a5991c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (805b8f42-961c-474c-a040-56008a5991c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223fb1ba-f46a-4ad0-8228-b1f00620f49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223fb1ba-f46a-4ad0-8228-b1f00620f49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0be97ad-fbe8-4111-b6ac-74b919ec683c', 'volume_name': 'volume-c0be97ad-fbe8-4111-b6ac-74b919ec683c', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630f7171-5ad2-471b-adf5-dcc41ce0329c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630f7171-5ad2-471b-adf5-dcc41ce0329c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ba4f8c-c23c-47b5-b918-f8f6007ca7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:37 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Volume c0be97ad-fbe8-4111-b6ac-74b919ec683c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0be97ad-fbe8-4111-b6ac-74b919ec683c', 'volume_size': 1} Jun 03 12:01:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:38 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.368s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:38 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:01:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53 1073741824" returned: 0 in 1.795s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:38 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:38 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53 Jun 03 12:01:38 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:39 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53" returned: 0 in 0.669s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] <== create_volume: return (2547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:01:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.551s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.114s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-987253394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0be97ad-fbe8-4111-b6ac-74b919ec683c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82a9f65922a4562abab77e856caeacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:01:37Z,use_quota=True,user_id='b0230be3367a489aab1de137363444a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:01:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Creating volume c0be97ad-fbe8-4111-b6ac-74b919ec683c {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:01:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:01:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:01:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:01:39 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:01:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0be97ad-fbe8-4111-b6ac-74b919ec683c 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a82f5d-b3b2-44ac-8b33-c80edc006fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-997c86a2-9113-4b39-856b-ba09054d5b53', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe914ec-45e8-47e1-963c-9979e46b9cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:39 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0be97ad-fbe8-4111-b6ac-74b919ec683c 1073741824 Jun 03 12:01:39 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:39 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Volume volume-997c86a2-9113-4b39-856b-ba09054d5b53 (997c86a2-9113-4b39-856b-ba09054d5b53): created successfully Jun 03 12:01:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe914ec-45e8-47e1-963c-9979e46b9cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Flow 'volume_create_manager' (e654f55f-95a9-42da-957f-8127ecf5dde1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:01:39 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d4f652b6-8427-42d5-b1a2-9d9f050da625 tempest-VolumesDeleteCascade-80362656 None] Created volume successfully. Jun 03 12:01:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e388a026-a782-4643-bf9b-aa30e8417562 tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:40 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0be97ad-fbe8-4111-b6ac-74b919ec683c 1073741824" returned: 0 in 1.123s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0be97ad-fbe8-4111-b6ac-74b919ec683c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:40 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0be97ad-fbe8-4111-b6ac-74b919ec683c Jun 03 12:01:40 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:41 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0be97ad-fbe8-4111-b6ac-74b919ec683c" returned: 0 in 0.799s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:41 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:01:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e388a026-a782-4643-bf9b-aa30e8417562 tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.456s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:41 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ba4f8c-c23c-47b5-b918-f8f6007ca7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0be97ad-fbe8-4111-b6ac-74b919ec683c', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:41 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25dbe26f-8d2b-45d9-94e2-74e1a7fd6d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:41 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-e388a026-a782-4643-bf9b-aa30e8417562 tempest-VolumesDeleteCascade-80362656 None] Creating offline snapshot 8c178e17-f713-4312-af15-f25de71d6179 of volume 997c86a2-9113-4b39-856b-ba09054d5b53 {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 12:01:41 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Volume volume-c0be97ad-fbe8-4111-b6ac-74b919ec683c (c0be97ad-fbe8-4111-b6ac-74b919ec683c): created successfully Jun 03 12:01:41 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25dbe26f-8d2b-45d9-94e2-74e1a7fd6d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:41 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Flow 'volume_create_manager' (8f509cbc-899a-4efe-91dd-75591d837ac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:01:41 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9284d1be-20bf-48a5-8e45-3bd62068f97e]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:01:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e388a026-a782-4643-bf9b-aa30e8417562 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:41 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-b96f34d6-be6a-49f2-a84a-dec964f17cdb tempest-TestMinimumBasicScenario-49936155 None] Created volume successfully. Jun 03 12:01:41 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53 Jun 03 12:01:41 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:42 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e388a026-a782-4643-bf9b-aa30e8417562 tempest-VolumesDeleteCascade-80362656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53" returned: 0 in 0.860s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e388a026-a782-4643-bf9b-aa30e8417562 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:42 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179 1G Jun 03 12:01:42 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:43 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e388a026-a782-4643-bf9b-aa30e8417562 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179 1G" returned: 0 in 0.941s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e388a026-a782-4643-bf9b-aa30e8417562 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-997c86a2-9113-4b39-856b-ba09054d5b53 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:43 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-997c86a2-9113-4b39-856b-ba09054d5b53 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179 Jun 03 12:01:43 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:44 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e388a026-a782-4643-bf9b-aa30e8417562 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-997c86a2-9113-4b39-856b-ba09054d5b53 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179" returned: 0 in 1.007s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:44 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-e388a026-a782-4643-bf9b-aa30e8417562 tempest-VolumesDeleteCascade-80362656 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179 is being set with open permissions: ugo+rw Jun 03 12:01:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e388a026-a782-4643-bf9b-aa30e8417562 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:44 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179 Jun 03 12:01:44 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:45 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e388a026-a782-4643-bf9b-aa30e8417562 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179" returned: 0 in 0.930s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e388a026-a782-4643-bf9b-aa30e8417562 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:45 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.info Jun 03 12:01:45 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:46 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:01:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Flow 'volume_create_manager' (0a0ea928-3947-4758-b0da-25e930469cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:01:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c97a3c5-782c-43b0-8a49-e691bff08ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c97a3c5-782c-43b0-8a49-e691bff08ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1948826271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba5915e-0784-4f90-9cc1-72009218c52d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c3410af75fb4ec9899b1de22d52530e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:01:46Z,use_quota=True,user_id='813e96b61277438c8833a3d3551f6ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dbec7e3-1b70-414b-9d6b-44ce6d717afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dbec7e3-1b70-414b-9d6b-44ce6d717afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0f04c8-2d07-404e-a3ce-1937830cd4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0f04c8-2d07-404e-a3ce-1937830cd4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ba5915e-0784-4f90-9cc1-72009218c52d', 'volume_name': 'volume-5ba5915e-0784-4f90-9cc1-72009218c52d', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4b506d-20a5-4d26-8f46-8dfca64508e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4b506d-20a5-4d26-8f46-8dfca64508e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ecc237-32ac-48f0-972b-2027d3a341ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:46 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Volume 5ba5915e-0784-4f90-9cc1-72009218c52d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ba5915e-0784-4f90-9cc1-72009218c52d', 'volume_size': 1} Jun 03 12:01:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:46 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e388a026-a782-4643-bf9b-aa30e8417562 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.info" returned: 0 in 1.091s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:46 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-e388a026-a782-4643-bf9b-aa30e8417562 tempest-VolumesDeleteCascade-80362656 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.info is being set with open permissions: ugo+rw Jun 03 12:01:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e388a026-a782-4643-bf9b-aa30e8417562 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:46 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.info Jun 03 12:01:46 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-7cb0c964-4098-4dc0-aa7a-731fcfd4bb57 req-69c5efcd-6d59-4dcd-a854-ecbe0e32accd tempest-TestMinimumBasicScenario-49936155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:47 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e388a026-a782-4643-bf9b-aa30e8417562 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.info" returned: 0 in 0.705s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e388a026-a782-4643-bf9b-aa30e8417562 tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.705s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.748s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1948826271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba5915e-0784-4f90-9cc1-72009218c52d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c3410af75fb4ec9899b1de22d52530e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:01:46Z,use_quota=True,user_id='813e96b61277438c8833a3d3551f6ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Creating volume 5ba5915e-0784-4f90-9cc1-72009218c52d {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:01:47 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ba5915e-0784-4f90-9cc1-72009218c52d 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:47 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ba5915e-0784-4f90-9cc1-72009218c52d 1073741824 Jun 03 12:01:47 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:47 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-e388a026-a782-4643-bf9b-aa30e8417562 tempest-VolumesDeleteCascade-80362656 None] Create snapshot completed successfully Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Flow 'volume_create_manager' (4d5fa85f-ad9a-4b9a-9081-92d26dd22252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b5c521-8f6c-4b79-ba7d-d280748fe9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b5c521-8f6c-4b79-ba7d-d280748fe9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1529907409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4d8183-b7f5-44b1-96f9-9ca875ee0127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22ce8d94a7d484eb9fb25af63c108ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8c178e17-f713-4312-af15-f25de71d6179,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:01:48Z,use_quota=True,user_id='bb735d4782d540f8bbdadfe50cd29fa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f66ba77-3597-4693-81c4-9c0d598bb827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f66ba77-3597-4693-81c4-9c0d598bb827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0750a09f-78cb-4d61-bbd3-3fbedc1ca7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0750a09f-78cb-4d61-bbd3-3fbedc1ca7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fc4d8183-b7f5-44b1-96f9-9ca875ee0127', 'volume_name': 'volume-fc4d8183-b7f5-44b1-96f9-9ca875ee0127', 'volume_size': 1, 'snapshot_id': '8c178e17-f713-4312-af15-f25de71d6179'}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58ee0a5-df1f-4430-841b-9684078a1305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58ee0a5-df1f-4430-841b-9684078a1305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7328f4-7d98-4c90-96c5-bcd3b4e29b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:47 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Volume fc4d8183-b7f5-44b1-96f9-9ca875ee0127: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fc4d8183-b7f5-44b1-96f9-9ca875ee0127', 'volume_size': 1, 'snapshot_id': '8c178e17-f713-4312-af15-f25de71d6179'} Jun 03 12:01:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:48 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ba5915e-0784-4f90-9cc1-72009218c52d 1073741824" returned: 0 in 0.935s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ba5915e-0784-4f90-9cc1-72009218c52d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:48 devstack sudo[98386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ba5915e-0784-4f90-9cc1-72009218c52d Jun 03 12:01:48 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:48 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ba5915e-0784-4f90-9cc1-72009218c52d" returned: 0 in 0.628s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:48 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:01:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-7cb0c964-4098-4dc0-aa7a-731fcfd4bb57 req-69c5efcd-6d59-4dcd-a854-ecbe0e32accd tempest-TestMinimumBasicScenario-49936155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.137s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:48 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e214e61-a56b-4a0d-97d2-b8a7cecab03b]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:01:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-7cb0c964-4098-4dc0-aa7a-731fcfd4bb57 req-69c5efcd-6d59-4dcd-a854-ecbe0e32accd tempest-TestMinimumBasicScenario-49936155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0be97ad-fbe8-4111-b6ac-74b919ec683c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ecc237-32ac-48f0-972b-2027d3a341ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ba5915e-0784-4f90-9cc1-72009218c52d', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ea0c13-604f-439e-a27c-641f43cb4569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:48 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Volume volume-5ba5915e-0784-4f90-9cc1-72009218c52d (5ba5915e-0784-4f90-9cc1-72009218c52d): created successfully Jun 03 12:01:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ea0c13-604f-439e-a27c-641f43cb4569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Flow 'volume_create_manager' (0a0ea928-3947-4758-b0da-25e930469cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:01:48 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-7c0246dd-1388-4992-b4ef-12eb4161aaa4 tempest-VolumesTransfersV357Test-1019616816 None] Created volume successfully. Jun 03 12:01:48 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0be97ad-fbe8-4111-b6ac-74b919ec683c Jun 03 12:01:48 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:49 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-7cb0c964-4098-4dc0-aa7a-731fcfd4bb57 req-69c5efcd-6d59-4dcd-a854-ecbe0e32accd tempest-TestMinimumBasicScenario-49936155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0be97ad-fbe8-4111-b6ac-74b919ec683c" returned: 0 in 0.746s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-7cb0c964-4098-4dc0-aa7a-731fcfd4bb57 req-69c5efcd-6d59-4dcd-a854-ecbe0e32accd tempest-TestMinimumBasicScenario-49936155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.770s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.555s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "cinder-quobyte-8c178e17-f713-4312-af15-f25de71d6179-fc4d8183-b7f5-44b1-96f9-9ca875ee0127" by "_create_volume_from_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-8c178e17-f713-4312-af15-f25de71d6179-fc4d8183-b7f5-44b1-96f9-9ca875ee0127" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Creating volume fc4d8183-b7f5-44b1-96f9-9ca875ee0127 from snapshot 8c178e17-f713-4312-af15-f25de71d6179 {{(pid=86724) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "cinder-quobyte-fc4d8183-b7f5-44b1-96f9-9ca875ee0127" by "_copy_volume_from_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-fc4d8183-b7f5-44b1-96f9-9ca875ee0127" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] snapshot: 8c178e17-f713-4312-af15-f25de71d6179, volume: fc4d8183-b7f5-44b1-96f9-9ca875ee0127, {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-7cb0c964-4098-4dc0-aa7a-731fcfd4bb57 req-69c5efcd-6d59-4dcd-a854-ecbe0e32accd tempest-TestMinimumBasicScenario-49936155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-c0be97ad-fbe8-4111-b6ac-74b919ec683c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60eb8bc9-525c-4476-b112-169dfadd7f62', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c792d578-0848-43f1-8969-105530c6e1ae]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:01:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:49 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-7cb0c964-4098-4dc0-aa7a-731fcfd4bb57 req-69c5efcd-6d59-4dcd-a854-ecbe0e32accd tempest-TestMinimumBasicScenario-49936155 None] attachment_update completed successfully. Jun 03 12:01:49 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179 Jun 03 12:01:49 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:50 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-be5d503e-86b0-42a4-9717-c223e4156c51 tempest-VolumesTransfersV357Test-640258938 None] Transfer volume completed successfully. Jun 03 12:01:50 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179" returned: 0 in 0.823s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:50 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-997c86a2-9113-4b39-856b-ba09054d5b53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:01:50 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] will copy from snapshot at /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53 {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 12:01:50 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Creating direct copy from snapshot {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 12:01:50 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d2b6ae-aac7-4113-bc95-9b903fdbe2a3]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:01:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:50 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53 Jun 03 12:01:50 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:51 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c254d301-289e-4b7b-9965-d32aad3b6025 tempest-VolumesTransfersV357Test-2124964844 None] Acquiring lock "cinder-5ba5915e-0784-4f90-9cc1-72009218c52d-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:01:51 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c254d301-289e-4b7b-9965-d32aad3b6025 tempest-VolumesTransfersV357Test-2124964844 None] Lock "cinder-5ba5915e-0784-4f90-9cc1-72009218c52d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:01:51 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c254d301-289e-4b7b-9965-d32aad3b6025 tempest-VolumesTransfersV357Test-2124964844 None] Acquiring lock "cinder-quobyte-5ba5915e-0784-4f90-9cc1-72009218c52d" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:01:51 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c254d301-289e-4b7b-9965-d32aad3b6025 tempest-VolumesTransfersV357Test-2124964844 None] Lock "cinder-quobyte-5ba5915e-0784-4f90-9cc1-72009218c52d" acquired by "delete_volume" :: waited 0.023s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:01:51 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd59f060-903c-4d4e-8ca9-3a12987a15fc]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:01:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c254d301-289e-4b7b-9965-d32aad3b6025 tempest-VolumesTransfersV357Test-2124964844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ba5915e-0784-4f90-9cc1-72009218c52d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-6a7a3fb3-a5f2-486f-bb01-7822bb6eed40 req-23ed467d-ea49-4887-9d91-7ac85b826054 tempest-TestInstancesWithCinderVolumes-1308894972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:51 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ba5915e-0784-4f90-9cc1-72009218c52d Jun 03 12:01:51 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:51 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53" returned: 0 in 0.890s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:51 devstack cinder-volume[86724]: DEBUG cinder.utils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Path /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fc4d8183-b7f5-44b1-96f9-9ca875ee0127 not found in is_blk_device check {{(pid=86724) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 03 12:01:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fc4d8183-b7f5-44b1-96f9-9ca875ee0127 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:51 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fc4d8183-b7f5-44b1-96f9-9ca875ee0127 Jun 03 12:01:51 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:52 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c254d301-289e-4b7b-9965-d32aad3b6025 tempest-VolumesTransfersV357Test-2124964844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ba5915e-0784-4f90-9cc1-72009218c52d" returned: 0 in 0.824s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c254d301-289e-4b7b-9965-d32aad3b6025 tempest-VolumesTransfersV357Test-2124964844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ba5915e-0784-4f90-9cc1-72009218c52d {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:52 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ba5915e-0784-4f90-9cc1-72009218c52d Jun 03 12:01:52 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:53 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c254d301-289e-4b7b-9965-d32aad3b6025 tempest-VolumesTransfersV357Test-2124964844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5ba5915e-0784-4f90-9cc1-72009218c52d" returned: 0 in 1.124s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:53 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c254d301-289e-4b7b-9965-d32aad3b6025 tempest-VolumesTransfersV357Test-2124964844 None] Lock "cinder-quobyte-5ba5915e-0784-4f90-9cc1-72009218c52d" released by "delete_volume" :: held 2.037s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:01:53 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-c254d301-289e-4b7b-9965-d32aad3b6025 tempest-VolumesTransfersV357Test-2124964844 None] Created reservations ['4f8ce573-6095-4a1e-a88c-1b2e7f07ac87', 'f5a8a9fa-b387-4a12-a34a-f59a9aaf7661', '3a1951f7-7336-4842-abd9-e2ae1c132919', '6419d8c9-e91d-4b99-9f6f-2af188b9c5fa'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:01:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c254d301-289e-4b7b-9965-d32aad3b6025 tempest-VolumesTransfersV357Test-2124964844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c254d301-289e-4b7b-9965-d32aad3b6025 tempest-VolumesTransfersV357Test-2124964844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:53 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c254d301-289e-4b7b-9965-d32aad3b6025 tempest-VolumesTransfersV357Test-2124964844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:01:53 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c254d301-289e-4b7b-9965-d32aad3b6025 tempest-VolumesTransfersV357Test-2124964844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:01:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c254d301-289e-4b7b-9965-d32aad3b6025 tempest-VolumesTransfersV357Test-2124964844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c254d301-289e-4b7b-9965-d32aad3b6025 tempest-VolumesTransfersV357Test-2124964844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:53 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:01:53 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:55 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c254d301-289e-4b7b-9965-d32aad3b6025 tempest-VolumesTransfersV357Test-2124964844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 2.209s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:55 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-c254d301-289e-4b7b-9965-d32aad3b6025 tempest-VolumesTransfersV357Test-2124964844 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:01:55 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c254d301-289e-4b7b-9965-d32aad3b6025 tempest-VolumesTransfersV357Test-2124964844 None] Deleted volume successfully. Jun 03 12:01:55 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c254d301-289e-4b7b-9965-d32aad3b6025 tempest-VolumesTransfersV357Test-2124964844 None] Lock "cinder-5ba5915e-0784-4f90-9cc1-72009218c52d-delete_volume" released by "delete_volume" :: held 4.704s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:01:56 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:01:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Flow 'volume_create_manager' (21b5c6f3-b2d5-4e3a-a281-327373884ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:01:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db667299-bc82-4d54-9820-82e8cdde4d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db667299-bc82-4d54-9820-82e8cdde4d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2135436445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59569677-0bbe-4234-a7ad-486f6e91008a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c3410af75fb4ec9899b1de22d52530e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:01:56Z,use_quota=True,user_id='813e96b61277438c8833a3d3551f6ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc7c073-97b8-4b30-bb5c-9290285ead14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc7c073-97b8-4b30-bb5c-9290285ead14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9950e864-cb8d-4289-83e7-00971a22acbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9950e864-cb8d-4289-83e7-00971a22acbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59569677-0bbe-4234-a7ad-486f6e91008a', 'volume_name': 'volume-59569677-0bbe-4234-a7ad-486f6e91008a', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a66cec9-88f5-4d85-a9d5-08d453f726e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a66cec9-88f5-4d85-a9d5-08d453f726e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255ccf27-d4ff-4b73-9c63-a43be68a6a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:56 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Volume 59569677-0bbe-4234-a7ad-486f6e91008a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59569677-0bbe-4234-a7ad-486f6e91008a', 'volume_size': 1} Jun 03 12:01:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:01:57 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fc4d8183-b7f5-44b1-96f9-9ca875ee0127" returned: 0 in 6.567s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:57 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edc2928-5bbf-47a3-a430-1376da48fbb3]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:01:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:58 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53 Jun 03 12:01:58 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:58 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53" returned: 0 in 0.930s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:58 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Image conversion details: src /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53, size 1024.00 MB, duration 6.57 sec, destination /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fc4d8183-b7f5-44b1-96f9-9ca875ee0127 {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 12:01:58 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Converted 1024.00 MB image at 155.91 MB/s Jun 03 12:01:58 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fc4d8183-b7f5-44b1-96f9-9ca875ee0127 is being set with open permissions: ugo+rw Jun 03 12:01:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fc4d8183-b7f5-44b1-96f9-9ca875ee0127 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:58 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fc4d8183-b7f5-44b1-96f9-9ca875ee0127 Jun 03 12:01:58 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:01:59 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Jun 03 12:01:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fc4d8183-b7f5-44b1-96f9-9ca875ee0127" returned: 0 in 0.641s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:01:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-fc4d8183-b7f5-44b1-96f9-9ca875ee0127" released by "_copy_volume_from_snapshot" :: held 9.976s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:01:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-8c178e17-f713-4312-af15-f25de71d6179-fc4d8183-b7f5-44b1-96f9-9ca875ee0127" released by "_create_volume_from_snapshot" :: held 10.015s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:01:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.052s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:01:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-6a7a3fb3-a5f2-486f-bb01-7822bb6eed40 req-23ed467d-ea49-4887-9d91-7ac85b826054 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.284s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:01:59 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e419033-bf11-43bd-92ee-a9c85b127a72]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:01:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-6a7a3fb3-a5f2-486f-bb01-7822bb6eed40 req-23ed467d-ea49-4887-9d91-7ac85b826054 tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5c6c0317-2671-4770-a722-7b7e1ad020b4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:01:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7328f4-7d98-4c90-96c5-bcd3b4e29b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc4d8183-b7f5-44b1-96f9-9ca875ee0127', 'volume_size': 1, 'snapshot_id': '8c178e17-f713-4312-af15-f25de71d6179'}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa2fc82-15c5-4bb6-835f-a239b118350a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:01:59 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Volume volume-fc4d8183-b7f5-44b1-96f9-9ca875ee0127 (fc4d8183-b7f5-44b1-96f9-9ca875ee0127): created successfully Jun 03 12:01:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa2fc82-15c5-4bb6-835f-a239b118350a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:01:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Flow 'volume_create_manager' (4d5fa85f-ad9a-4b9a-9081-92d26dd22252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:01:59 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-8b53de36-2215-466e-ae1f-5031d0df5e7f tempest-VolumesDeleteCascade-80362656 None] Created volume successfully. Jun 03 12:01:59 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5c6c0317-2671-4770-a722-7b7e1ad020b4 Jun 03 12:01:59 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "cinder-997c86a2-9113-4b39-856b-ba09054d5b53-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-997c86a2-9113-4b39-856b-ba09054d5b53-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Performing cascade delete. {{(pid=86724) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "cinder-8c178e17-f713-4312-af15-f25de71d6179-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-8c178e17-f713-4312-af15-f25de71d6179-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "cinder-quobyte-997c86a2-9113-4b39-856b-ba09054d5b53" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-997c86a2-9113-4b39-856b-ba09054d5b53" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "cinder-quobyte-8c178e17-f713-4312-af15-f25de71d6179" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-8c178e17-f713-4312-af15-f25de71d6179" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Deleting offline snapshot 8c178e17-f713-4312-af15-f25de71d6179 of volume 997c86a2-9113-4b39-856b-ba09054d5b53 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] snapshot_file for this snap is: volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 12:02:00 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-6a7a3fb3-a5f2-486f-bb01-7822bb6eed40 req-23ed467d-ea49-4887-9d91-7ac85b826054 tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5c6c0317-2671-4770-a722-7b7e1ad020b4" returned: 0 in 0.910s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-6a7a3fb3-a5f2-486f-bb01-7822bb6eed40 req-23ed467d-ea49-4887-9d91-7ac85b826054 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.944s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9809a9d6-1604-4385-aec8-eb7024e3c803]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.290s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2135436445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59569677-0bbe-4234-a7ad-486f6e91008a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c3410af75fb4ec9899b1de22d52530e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:01:56Z,use_quota=True,user_id='813e96b61277438c8833a3d3551f6ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Creating volume 59569677-0bbe-4234-a7ad-486f6e91008a {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:02:00 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-59569677-0bbe-4234-a7ad-486f6e91008a 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:00 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-59569677-0bbe-4234-a7ad-486f6e91008a 1073741824 Jun 03 12:02:00 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-6a7a3fb3-a5f2-486f-bb01-7822bb6eed40 req-23ed467d-ea49-4887-9d91-7ac85b826054 tempest-TestInstancesWithCinderVolumes-1308894972 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-5c6c0317-2671-4770-a722-7b7e1ad020b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35471cab-35d7-496d-82ff-5802378d21c0', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 12:02:00 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179 Jun 03 12:02:00 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:00 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-6a7a3fb3-a5f2-486f-bb01-7822bb6eed40 req-23ed467d-ea49-4887-9d91-7ac85b826054 tempest-TestInstancesWithCinderVolumes-1308894972 None] attachment_update completed successfully. Jun 03 12:02:01 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179" returned: 0 in 1.090s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-997c86a2-9113-4b39-856b-ba09054d5b53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:02:01 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-59569677-0bbe-4234-a7ad-486f6e91008a 1073741824" returned: 0 in 1.162s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:01 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[67170ff6-2891-4be6-bc74-a6feae6e30de]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:02:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-59569677-0bbe-4234-a7ad-486f6e91008a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:01 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-59569677-0bbe-4234-a7ad-486f6e91008a Jun 03 12:02:01 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:01 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53 Jun 03 12:02:01 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:02 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-59569677-0bbe-4234-a7ad-486f6e91008a" returned: 0 in 0.680s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:02 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:02:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255ccf27-d4ff-4b73-9c63-a43be68a6a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59569677-0bbe-4234-a7ad-486f6e91008a', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dbaf3dc-a70c-4c67-bb16-94408849e64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:02 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Volume volume-59569677-0bbe-4234-a7ad-486f6e91008a (59569677-0bbe-4234-a7ad-486f6e91008a): created successfully Jun 03 12:02:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dbaf3dc-a70c-4c67-bb16-94408849e64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Flow 'volume_create_manager' (21b5c6f3-b2d5-4e3a-a281-327373884ac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:02:02 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-1afe250e-8878-487f-a39a-6d548d79b1ec tempest-VolumesTransfersV357Test-1019616816 None] Created volume successfully. Jun 03 12:02:02 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53" returned: 0 in 0.799s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:02 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179 Jun 03 12:02:02 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b7f754c2-41d7-45f7-aa4d-ea7dca97e959 tempest-VolumesTransfersV357Test-2124964844 None] Acquiring lock "cinder-59569677-0bbe-4234-a7ad-486f6e91008a-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:02:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b7f754c2-41d7-45f7-aa4d-ea7dca97e959 tempest-VolumesTransfersV357Test-2124964844 None] Lock "cinder-59569677-0bbe-4234-a7ad-486f6e91008a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:02:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b7f754c2-41d7-45f7-aa4d-ea7dca97e959 tempest-VolumesTransfersV357Test-2124964844 None] Acquiring lock "cinder-quobyte-59569677-0bbe-4234-a7ad-486f6e91008a" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:02:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b7f754c2-41d7-45f7-aa4d-ea7dca97e959 tempest-VolumesTransfersV357Test-2124964844 None] Lock "cinder-quobyte-59569677-0bbe-4234-a7ad-486f6e91008a" acquired by "delete_volume" :: waited 0.020s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:02:03 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dfbb76-b7f8-4737-9cc7-fbbd3e8464f4]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:02:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b7f754c2-41d7-45f7-aa4d-ea7dca97e959 tempest-VolumesTransfersV357Test-2124964844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-59569677-0bbe-4234-a7ad-486f6e91008a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:03 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-59569677-0bbe-4234-a7ad-486f6e91008a Jun 03 12:02:03 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:03 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179" returned: 0 in 0.846s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:03 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179 Jun 03 12:02:03 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:04 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b7f754c2-41d7-45f7-aa4d-ea7dca97e959 tempest-VolumesTransfersV357Test-2124964844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-59569677-0bbe-4234-a7ad-486f6e91008a" returned: 0 in 0.854s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b7f754c2-41d7-45f7-aa4d-ea7dca97e959 tempest-VolumesTransfersV357Test-2124964844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-59569677-0bbe-4234-a7ad-486f6e91008a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:04 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-59569677-0bbe-4234-a7ad-486f6e91008a Jun 03 12:02:04 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:04 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53.8c178e17-f713-4312-af15-f25de71d6179" returned: 0 in 0.903s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:04 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-8c178e17-f713-4312-af15-f25de71d6179" released by "_delete_snapshot" :: held 3.861s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:02:04 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-997c86a2-9113-4b39-856b-ba09054d5b53" released by "delete_snapshot" :: held 3.910s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:02:04 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Created reservations ['40df21a6-c861-4ba6-ab16-ac3c4cfe6da5', 'e937aea4-d296-4361-981d-f3941de495cd', 'd2307a0e-571e-4a76-a4c0-cc86978ab53e', '36c2d84c-7508-4702-b144-15cfc65e17d6'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:02:04 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Delete snapshot completed successfully. Jun 03 12:02:04 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-8c178e17-f713-4312-af15-f25de71d6179-delete_snapshot" released by "delete_snapshot" :: held 4.159s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:02:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Snapshots deleted, issuing volume delete {{(pid=86724) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 03 12:02:04 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "cinder-quobyte-997c86a2-9113-4b39-856b-ba09054d5b53" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:02:04 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-997c86a2-9113-4b39-856b-ba09054d5b53" acquired by "delete_volume" :: waited 0.016s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:02:04 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae0a23d-3abf-444b-bc30-edc2133a531d]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:02:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:04 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53 Jun 03 12:02:04 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:04 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b7f754c2-41d7-45f7-aa4d-ea7dca97e959 tempest-VolumesTransfersV357Test-2124964844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-59569677-0bbe-4234-a7ad-486f6e91008a" returned: 0 in 0.741s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:04 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b7f754c2-41d7-45f7-aa4d-ea7dca97e959 tempest-VolumesTransfersV357Test-2124964844 None] Lock "cinder-quobyte-59569677-0bbe-4234-a7ad-486f6e91008a" released by "delete_volume" :: held 1.645s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:02:04 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-b7f754c2-41d7-45f7-aa4d-ea7dca97e959 tempest-VolumesTransfersV357Test-2124964844 None] Created reservations ['672aa15b-02b7-4289-968a-fc382ff6a6d0', 'ee87d84e-314b-4593-92e3-4516373a03e5', 'f0f1cd33-4602-4f5d-9dbc-fc397ea8c0c5', 'c65e17d6-5b92-48dd-a9bc-1560234d5f1c'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:02:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b7f754c2-41d7-45f7-aa4d-ea7dca97e959 tempest-VolumesTransfersV357Test-2124964844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b7f754c2-41d7-45f7-aa4d-ea7dca97e959 tempest-VolumesTransfersV357Test-2124964844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:04 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b7f754c2-41d7-45f7-aa4d-ea7dca97e959 tempest-VolumesTransfersV357Test-2124964844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:02:04 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b7f754c2-41d7-45f7-aa4d-ea7dca97e959 tempest-VolumesTransfersV357Test-2124964844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:02:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b7f754c2-41d7-45f7-aa4d-ea7dca97e959 tempest-VolumesTransfersV357Test-2124964844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b7f754c2-41d7-45f7-aa4d-ea7dca97e959 tempest-VolumesTransfersV357Test-2124964844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:04 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:02:04 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:05 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53" returned: 0 in 0.866s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:05 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53 Jun 03 12:02:05 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:05 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b7f754c2-41d7-45f7-aa4d-ea7dca97e959 tempest-VolumesTransfersV357Test-2124964844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.737s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:05 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-b7f754c2-41d7-45f7-aa4d-ea7dca97e959 tempest-VolumesTransfersV357Test-2124964844 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:02:05 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-b7f754c2-41d7-45f7-aa4d-ea7dca97e959 tempest-VolumesTransfersV357Test-2124964844 None] Deleted volume successfully. Jun 03 12:02:05 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b7f754c2-41d7-45f7-aa4d-ea7dca97e959 tempest-VolumesTransfersV357Test-2124964844 None] Lock "cinder-59569677-0bbe-4234-a7ad-486f6e91008a-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:02:06 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-997c86a2-9113-4b39-856b-ba09054d5b53" returned: 0 in 0.747s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:06 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-997c86a2-9113-4b39-856b-ba09054d5b53" released by "delete_volume" :: held 1.685s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:02:06 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Created reservations ['3ec96af4-58de-487e-a484-dd1890a1c8ef', 'ba64a7e6-8830-45ec-88ac-70696ad5d2cf', '0d241a2e-a662-4581-8ba5-028e9e34c69a', '7f859430-0237-44ab-9e13-8b3034720018'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:02:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:02:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:02:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:06 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:02:06 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:07 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:07 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7e1bb110-4cd3-4084-8d47-f17ea07027f2 tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "cinder-fc4d8183-b7f5-44b1-96f9-9ca875ee0127-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:02:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.694s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:07 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:02:07 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Deleted volume successfully. Jun 03 12:02:07 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7e1bb110-4cd3-4084-8d47-f17ea07027f2 tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-fc4d8183-b7f5-44b1-96f9-9ca875ee0127-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:02:07 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7f508976-1628-4901-a520-d2bad0fb47ea tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-997c86a2-9113-4b39-856b-ba09054d5b53-delete_volume" released by "delete_volume" :: held 6.830s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:02:07 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7e1bb110-4cd3-4084-8d47-f17ea07027f2 tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "cinder-quobyte-fc4d8183-b7f5-44b1-96f9-9ca875ee0127" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:02:07 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7e1bb110-4cd3-4084-8d47-f17ea07027f2 tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-fc4d8183-b7f5-44b1-96f9-9ca875ee0127" acquired by "delete_volume" :: waited 0.019s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:02:07 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[43958823-3a7c-4036-8a6c-fe52ec9d8b94]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:02:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e1bb110-4cd3-4084-8d47-f17ea07027f2 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fc4d8183-b7f5-44b1-96f9-9ca875ee0127 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:07 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fc4d8183-b7f5-44b1-96f9-9ca875ee0127 Jun 03 12:02:07 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:08 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e1bb110-4cd3-4084-8d47-f17ea07027f2 tempest-VolumesDeleteCascade-80362656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fc4d8183-b7f5-44b1-96f9-9ca875ee0127" returned: 0 in 0.844s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e1bb110-4cd3-4084-8d47-f17ea07027f2 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fc4d8183-b7f5-44b1-96f9-9ca875ee0127 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:08 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fc4d8183-b7f5-44b1-96f9-9ca875ee0127 Jun 03 12:02:08 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-36479eeb-47cc-4f60-a3e7-c59b78f3b490 req-42929337-6af5-4010-8b49-a6e68875568c tempest-TestInstancesWithCinderVolumes-1308894972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-36479eeb-47cc-4f60-a3e7-c59b78f3b490 req-42929337-6af5-4010-8b49-a6e68875568c tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:08 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e735533f-32c7-461e-90f0-740e72ce8923]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:02:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-36479eeb-47cc-4f60-a3e7-c59b78f3b490 req-42929337-6af5-4010-8b49-a6e68875568c tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-00d827b0-3b70-40e0-a29e-aef847f48b1c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:08 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-00d827b0-3b70-40e0-a29e-aef847f48b1c Jun 03 12:02:08 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:08 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e1bb110-4cd3-4084-8d47-f17ea07027f2 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fc4d8183-b7f5-44b1-96f9-9ca875ee0127" returned: 0 in 0.836s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7e1bb110-4cd3-4084-8d47-f17ea07027f2 tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-quobyte-fc4d8183-b7f5-44b1-96f9-9ca875ee0127" released by "delete_volume" :: held 1.725s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:02:08 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-7e1bb110-4cd3-4084-8d47-f17ea07027f2 tempest-VolumesDeleteCascade-80362656 None] Created reservations ['80d3dda8-1e52-4a5e-8cc9-c92702ad945e', 'c09f58b3-75ab-4799-b982-c8d52954aeba', 'd607aa0a-313c-4a3e-bbcc-2a4562eec7da', 'c92a4532-bb1a-41d3-a0d6-0fd866d737f4'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:02:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7e1bb110-4cd3-4084-8d47-f17ea07027f2 tempest-VolumesDeleteCascade-80362656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7e1bb110-4cd3-4084-8d47-f17ea07027f2 tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7e1bb110-4cd3-4084-8d47-f17ea07027f2 tempest-VolumesDeleteCascade-80362656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:02:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7e1bb110-4cd3-4084-8d47-f17ea07027f2 tempest-VolumesDeleteCascade-80362656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:02:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7e1bb110-4cd3-4084-8d47-f17ea07027f2 tempest-VolumesDeleteCascade-80362656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e1bb110-4cd3-4084-8d47-f17ea07027f2 tempest-VolumesDeleteCascade-80362656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:09 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:02:09 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:09 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-36479eeb-47cc-4f60-a3e7-c59b78f3b490 req-42929337-6af5-4010-8b49-a6e68875568c tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-00d827b0-3b70-40e0-a29e-aef847f48b1c" returned: 0 in 0.964s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-36479eeb-47cc-4f60-a3e7-c59b78f3b490 req-42929337-6af5-4010-8b49-a6e68875568c tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.986s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-36479eeb-47cc-4f60-a3e7-c59b78f3b490 req-42929337-6af5-4010-8b49-a6e68875568c tempest-TestInstancesWithCinderVolumes-1308894972 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-00d827b0-3b70-40e0-a29e-aef847f48b1c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de4d409d-a6c2-4f7a-92c4-8297d6f290de', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 12:02:09 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-36479eeb-47cc-4f60-a3e7-c59b78f3b490 req-42929337-6af5-4010-8b49-a6e68875568c tempest-TestInstancesWithCinderVolumes-1308894972 None] attachment_update completed successfully. Jun 03 12:02:09 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7e1bb110-4cd3-4084-8d47-f17ea07027f2 tempest-VolumesDeleteCascade-80362656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.771s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:09 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-7e1bb110-4cd3-4084-8d47-f17ea07027f2 tempest-VolumesDeleteCascade-80362656 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:02:09 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-7e1bb110-4cd3-4084-8d47-f17ea07027f2 tempest-VolumesDeleteCascade-80362656 None] Deleted volume successfully. Jun 03 12:02:09 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7e1bb110-4cd3-4084-8d47-f17ea07027f2 tempest-VolumesDeleteCascade-80362656 None] Lock "cinder-fc4d8183-b7f5-44b1-96f9-9ca875ee0127-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Flow 'volume_create_manager' (2d1358a0-fb36-417c-b700-93f4c185dda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb0590f-30c7-4241-a3b1-30907c4dbf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb0590f-30c7-4241-a3b1-30907c4dbf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-238784774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed8b658-bdbd-41e2-843c-7bf910fda1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c0ae3b1bcb64d2f9ce811d230ec4da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:02:15Z,use_quota=True,user_id='ea65cfd405e943768d66091d395c058d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54fc6fd8-7455-42fd-a171-c13945cb47dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54fc6fd8-7455-42fd-a171-c13945cb47dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0f650b-4412-4c2c-9b17-57c1d5b7af3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0f650b-4412-4c2c-9b17-57c1d5b7af3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed8b658-bdbd-41e2-843c-7bf910fda1da', 'volume_name': 'volume-eed8b658-bdbd-41e2-843c-7bf910fda1da', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6a94fe-6e65-416d-aeec-d1f9c1ca7070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6a94fe-6e65-416d-aeec-d1f9c1ca7070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf7955c-cc0d-42b0-9631-a90a21f11d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:14 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Volume eed8b658-bdbd-41e2-843c-7bf910fda1da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed8b658-bdbd-41e2-843c-7bf910fda1da', 'volume_size': 1} Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-238784774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed8b658-bdbd-41e2-843c-7bf910fda1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c0ae3b1bcb64d2f9ce811d230ec4da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:02:15Z,use_quota=True,user_id='ea65cfd405e943768d66091d395c058d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Creating volume eed8b658-bdbd-41e2-843c-7bf910fda1da {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:02:14 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:02:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-eed8b658-bdbd-41e2-843c-7bf910fda1da 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:14 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-eed8b658-bdbd-41e2-843c-7bf910fda1da 1073741824 Jun 03 12:02:14 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:15 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-eed8b658-bdbd-41e2-843c-7bf910fda1da 1073741824" returned: 0 in 0.981s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-eed8b658-bdbd-41e2-843c-7bf910fda1da {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:15 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-eed8b658-bdbd-41e2-843c-7bf910fda1da Jun 03 12:02:15 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:16 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-eed8b658-bdbd-41e2-843c-7bf910fda1da" returned: 0 in 0.658s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:16 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:02:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf7955c-cc0d-42b0-9631-a90a21f11d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed8b658-bdbd-41e2-843c-7bf910fda1da', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d30f37-0d4e-4ea9-8fe7-16203ee3f5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:16 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Volume volume-eed8b658-bdbd-41e2-843c-7bf910fda1da (eed8b658-bdbd-41e2-843c-7bf910fda1da): created successfully Jun 03 12:02:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d30f37-0d4e-4ea9-8fe7-16203ee3f5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Flow 'volume_create_manager' (2d1358a0-fb36-417c-b700-93f4c185dda2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:02:16 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-4fd738b4-8d34-496e-9fa1-10d47eed5c4c tempest-VolumesTransfersTest-2004451786 None] Created volume successfully. Jun 03 12:02:17 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-b4714cc3-2f9d-4d45-97bd-e411e7798caa tempest-VolumesTransfersTest-655530809 None] Transfer volume completed successfully. Jun 03 12:02:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fe69130c-bb88-42e2-8acc-f145e1860e81 tempest-VolumesTransfersTest-1290607760 None] Acquiring lock "cinder-eed8b658-bdbd-41e2-843c-7bf910fda1da-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:02:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fe69130c-bb88-42e2-8acc-f145e1860e81 tempest-VolumesTransfersTest-1290607760 None] Lock "cinder-eed8b658-bdbd-41e2-843c-7bf910fda1da-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:02:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fe69130c-bb88-42e2-8acc-f145e1860e81 tempest-VolumesTransfersTest-1290607760 None] Acquiring lock "cinder-quobyte-eed8b658-bdbd-41e2-843c-7bf910fda1da" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:02:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fe69130c-bb88-42e2-8acc-f145e1860e81 tempest-VolumesTransfersTest-1290607760 None] Lock "cinder-quobyte-eed8b658-bdbd-41e2-843c-7bf910fda1da" acquired by "delete_volume" :: waited 0.025s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:02:18 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c14838-3a18-4c62-8b92-e325af62edd7]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:02:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fe69130c-bb88-42e2-8acc-f145e1860e81 tempest-VolumesTransfersTest-1290607760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-eed8b658-bdbd-41e2-843c-7bf910fda1da {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:19 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-eed8b658-bdbd-41e2-843c-7bf910fda1da Jun 03 12:02:19 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:19 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fe69130c-bb88-42e2-8acc-f145e1860e81 tempest-VolumesTransfersTest-1290607760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-eed8b658-bdbd-41e2-843c-7bf910fda1da" returned: 0 in 0.943s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fe69130c-bb88-42e2-8acc-f145e1860e81 tempest-VolumesTransfersTest-1290607760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-eed8b658-bdbd-41e2-843c-7bf910fda1da {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:19 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-eed8b658-bdbd-41e2-843c-7bf910fda1da Jun 03 12:02:19 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:20 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-d3f78e61-c2af-4eee-8ff4-f28135084dc3 req-38b8440e-9ee6-43e4-8447-ece5f52a6bf9 tempest-TestInstancesWithCinderVolumes-1308894972 None] Terminate volume connection completed successfully. Jun 03 12:02:20 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-d3f78e61-c2af-4eee-8ff4-f28135084dc3 req-38b8440e-9ee6-43e4-8447-ece5f52a6bf9 tempest-TestInstancesWithCinderVolumes-1308894972 None] Deleting attachment 35471cab-35d7-496d-82ff-5802378d21c0. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 12:02:20 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fe69130c-bb88-42e2-8acc-f145e1860e81 tempest-VolumesTransfersTest-1290607760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-eed8b658-bdbd-41e2-843c-7bf910fda1da" returned: 0 in 0.688s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fe69130c-bb88-42e2-8acc-f145e1860e81 tempest-VolumesTransfersTest-1290607760 None] Lock "cinder-quobyte-eed8b658-bdbd-41e2-843c-7bf910fda1da" released by "delete_volume" :: held 1.690s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:02:20 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:UPDATE=105,cinder:SELECT=90,cinder:INSERT=25,cinder:DELETE=7 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:02:20 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-fe69130c-bb88-42e2-8acc-f145e1860e81 tempest-VolumesTransfersTest-1290607760 None] Created reservations ['281719cc-3094-4b12-a70a-195aef8d28f9', '9a7d1888-35e6-40a0-b655-1aa35a09a612', 'ffdba1df-e40e-4356-bc43-ec299f5bb907', '5fec688b-8b2d-404c-bb9e-42e1463670b0'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:02:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fe69130c-bb88-42e2-8acc-f145e1860e81 tempest-VolumesTransfersTest-1290607760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fe69130c-bb88-42e2-8acc-f145e1860e81 tempest-VolumesTransfersTest-1290607760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fe69130c-bb88-42e2-8acc-f145e1860e81 tempest-VolumesTransfersTest-1290607760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:02:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fe69130c-bb88-42e2-8acc-f145e1860e81 tempest-VolumesTransfersTest-1290607760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:02:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fe69130c-bb88-42e2-8acc-f145e1860e81 tempest-VolumesTransfersTest-1290607760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fe69130c-bb88-42e2-8acc-f145e1860e81 tempest-VolumesTransfersTest-1290607760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:20 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:02:20 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:21 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fe69130c-bb88-42e2-8acc-f145e1860e81 tempest-VolumesTransfersTest-1290607760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.180s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:21 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-fe69130c-bb88-42e2-8acc-f145e1860e81 tempest-VolumesTransfersTest-1290607760 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:02:21 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-fe69130c-bb88-42e2-8acc-f145e1860e81 tempest-VolumesTransfersTest-1290607760 None] Deleted volume successfully. Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fe69130c-bb88-42e2-8acc-f145e1860e81 tempest-VolumesTransfersTest-1290607760 None] Lock "cinder-eed8b658-bdbd-41e2-843c-7bf910fda1da-delete_volume" released by "delete_volume" :: held 3.142s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Flow 'volume_create_manager' (924910fb-58e6-402d-a020-430f618fa341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52276406-37b1-489d-89c7-e359020cf58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=91,cinder:INSERT=25,cinder:UPDATE=102,cinder:DELETE=9 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52276406-37b1-489d-89c7-e359020cf58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-356578340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34fd9cd-2482-4f4a-b305-1c54f38bacf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c0ae3b1bcb64d2f9ce811d230ec4da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:02:22Z,use_quota=True,user_id='ea65cfd405e943768d66091d395c058d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f55582-d2a5-4d24-9a4d-bf7b981b1998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f55582-d2a5-4d24-9a4d-bf7b981b1998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1818946b-7532-4354-bbbb-0cd6bd5db36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1818946b-7532-4354-bbbb-0cd6bd5db36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c34fd9cd-2482-4f4a-b305-1c54f38bacf6', 'volume_name': 'volume-c34fd9cd-2482-4f4a-b305-1c54f38bacf6', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e8f94f-bd8e-44d0-b340-315ac308aa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e8f94f-bd8e-44d0-b340-315ac308aa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf49949-c0f6-4fed-9469-5f15244d843a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:22 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Volume c34fd9cd-2482-4f4a-b305-1c54f38bacf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c34fd9cd-2482-4f4a-b305-1c54f38bacf6', 'volume_size': 1} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-356578340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34fd9cd-2482-4f4a-b305-1c54f38bacf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c0ae3b1bcb64d2f9ce811d230ec4da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:02:22Z,use_quota=True,user_id='ea65cfd405e943768d66091d395c058d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Creating volume c34fd9cd-2482-4f4a-b305-1c54f38bacf6 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:02:22 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c34fd9cd-2482-4f4a-b305-1c54f38bacf6 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:22 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c34fd9cd-2482-4f4a-b305-1c54f38bacf6 1073741824 Jun 03 12:02:22 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] Acquiring lock "cinder-5c6c0317-2671-4770-a722-7b7e1ad020b4-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "cinder-5c6c0317-2671-4770-a722-7b7e1ad020b4-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] Acquiring lock "cinder-quobyte-5c6c0317-2671-4770-a722-7b7e1ad020b4" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "cinder-quobyte-5c6c0317-2671-4770-a722-7b7e1ad020b4" acquired by "delete_volume" :: waited 0.038s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f83aafa-18c3-409e-b7f7-61b3520a9f8d]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:02:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5c6c0317-2671-4770-a722-7b7e1ad020b4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:22 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5c6c0317-2671-4770-a722-7b7e1ad020b4 Jun 03 12:02:22 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:24 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c34fd9cd-2482-4f4a-b305-1c54f38bacf6 1073741824" returned: 0 in 1.766s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c34fd9cd-2482-4f4a-b305-1c54f38bacf6 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:24 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c34fd9cd-2482-4f4a-b305-1c54f38bacf6 Jun 03 12:02:24 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:24 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5c6c0317-2671-4770-a722-7b7e1ad020b4" returned: 0 in 1.770s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5c6c0317-2671-4770-a722-7b7e1ad020b4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:24 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5c6c0317-2671-4770-a722-7b7e1ad020b4 Jun 03 12:02:24 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:25 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5c6c0317-2671-4770-a722-7b7e1ad020b4" returned: 0 in 1.348s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "cinder-quobyte-5c6c0317-2671-4770-a722-7b7e1ad020b4" released by "delete_volume" :: held 3.228s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:02:25 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c34fd9cd-2482-4f4a-b305-1c54f38bacf6" returned: 0 in 1.779s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:25 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] <== create_volume: return (3677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:02:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.688s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:25 devstack cinder-volume[86724]: WARNING cinder.quota [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1289154443-1566045172 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1289154443-1566045172, it is now deprecated. Please use the default quota class for default quota. Jun 03 12:02:25 devstack cinder-volume[86724]: WARNING cinder.quota [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1289154443-1566045172 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1289154443-1566045172, it is now deprecated. Please use the default quota class for default quota. Jun 03 12:02:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf49949-c0f6-4fed-9469-5f15244d843a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c34fd9cd-2482-4f4a-b305-1c54f38bacf6', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1abdce3a-ea07-49ec-92d8-bd4af652a46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:25 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] Created reservations ['63316c8b-1d3e-45d3-8fcf-a816e9f01283', '525d0e92-c46f-477d-9967-fc4374a2cf39', 'd4e470b2-0045-42f1-9156-9132b366ffcd', '520de5ed-0e1a-4ade-9e16-9aa35b528913'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:02:25 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Volume volume-c34fd9cd-2482-4f4a-b305-1c54f38bacf6 (c34fd9cd-2482-4f4a-b305-1c54f38bacf6): created successfully Jun 03 12:02:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1abdce3a-ea07-49ec-92d8-bd4af652a46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Flow 'volume_create_manager' (924910fb-58e6-402d-a020-430f618fa341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:02:26 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a509c63b-3b09-4653-86e8-d0846d41d534 tempest-VolumesTransfersTest-2004451786 None] Created volume successfully. Jun 03 12:02:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:26 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:02:26 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:02:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:26 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:02:26 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-dbdc75b9-2c33-4c02-9635-fa3b4ccb9862 tempest-VolumesTransfersTest-1290607760 None] Acquiring lock "cinder-c34fd9cd-2482-4f4a-b305-1c54f38bacf6-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:02:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-dbdc75b9-2c33-4c02-9635-fa3b4ccb9862 tempest-VolumesTransfersTest-1290607760 None] Lock "cinder-c34fd9cd-2482-4f4a-b305-1c54f38bacf6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:02:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-dbdc75b9-2c33-4c02-9635-fa3b4ccb9862 tempest-VolumesTransfersTest-1290607760 None] Acquiring lock "cinder-quobyte-c34fd9cd-2482-4f4a-b305-1c54f38bacf6" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:02:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-dbdc75b9-2c33-4c02-9635-fa3b4ccb9862 tempest-VolumesTransfersTest-1290607760 None] Lock "cinder-quobyte-c34fd9cd-2482-4f4a-b305-1c54f38bacf6" acquired by "delete_volume" :: waited 0.020s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:02:27 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1687b7de-13ec-4aa5-9803-26272ef77cd5]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:02:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dbdc75b9-2c33-4c02-9635-fa3b4ccb9862 tempest-VolumesTransfersTest-1290607760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c34fd9cd-2482-4f4a-b305-1c54f38bacf6 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:27 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c34fd9cd-2482-4f4a-b305-1c54f38bacf6 Jun 03 12:02:27 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:27 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.506s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:27 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:02:27 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] Deleted volume successfully. Jun 03 12:02:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a5f56577-b14e-4d1e-b095-82934b815281 tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "cinder-5c6c0317-2671-4770-a722-7b7e1ad020b4-delete_volume" released by "delete_volume" :: held 5.337s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:02:28 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dbdc75b9-2c33-4c02-9635-fa3b4ccb9862 tempest-VolumesTransfersTest-1290607760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c34fd9cd-2482-4f4a-b305-1c54f38bacf6" returned: 0 in 1.229s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dbdc75b9-2c33-4c02-9635-fa3b4ccb9862 tempest-VolumesTransfersTest-1290607760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c34fd9cd-2482-4f4a-b305-1c54f38bacf6 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:28 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c34fd9cd-2482-4f4a-b305-1c54f38bacf6 Jun 03 12:02:28 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:29 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dbdc75b9-2c33-4c02-9635-fa3b4ccb9862 tempest-VolumesTransfersTest-1290607760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c34fd9cd-2482-4f4a-b305-1c54f38bacf6" returned: 0 in 0.683s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:29 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-dbdc75b9-2c33-4c02-9635-fa3b4ccb9862 tempest-VolumesTransfersTest-1290607760 None] Lock "cinder-quobyte-c34fd9cd-2482-4f4a-b305-1c54f38bacf6" released by "delete_volume" :: held 2.000s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:02:29 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-dbdc75b9-2c33-4c02-9635-fa3b4ccb9862 tempest-VolumesTransfersTest-1290607760 None] Created reservations ['68875f72-7200-48c4-ac9b-b2be27a92dc7', 'a4c516e6-9731-4e42-83d9-6c77c7e3bdae', '6f8204c2-32d0-4ada-814e-754dcddd17a3', 'b66844eb-4ee7-4741-82f0-ee5407090c49'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:02:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dbdc75b9-2c33-4c02-9635-fa3b4ccb9862 tempest-VolumesTransfersTest-1290607760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dbdc75b9-2c33-4c02-9635-fa3b4ccb9862 tempest-VolumesTransfersTest-1290607760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:29 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-dbdc75b9-2c33-4c02-9635-fa3b4ccb9862 tempest-VolumesTransfersTest-1290607760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:02:29 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-dbdc75b9-2c33-4c02-9635-fa3b4ccb9862 tempest-VolumesTransfersTest-1290607760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:02:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dbdc75b9-2c33-4c02-9635-fa3b4ccb9862 tempest-VolumesTransfersTest-1290607760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dbdc75b9-2c33-4c02-9635-fa3b4ccb9862 tempest-VolumesTransfersTest-1290607760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:29 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:02:29 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:30 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-1173796f-6294-4e31-8c9a-7f28edd98fb1 req-6f492865-effe-40d1-8d0e-496a7f670d95 tempest-TestInstancesWithCinderVolumes-1308894972 None] Terminate volume connection completed successfully. Jun 03 12:02:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-1173796f-6294-4e31-8c9a-7f28edd98fb1 req-6f492865-effe-40d1-8d0e-496a7f670d95 tempest-TestInstancesWithCinderVolumes-1308894972 None] Deleting attachment de4d409d-a6c2-4f7a-92c4-8297d6f290de. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 12:02:30 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dbdc75b9-2c33-4c02-9635-fa3b4ccb9862 tempest-VolumesTransfersTest-1290607760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.945s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:30 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-dbdc75b9-2c33-4c02-9635-fa3b4ccb9862 tempest-VolumesTransfersTest-1290607760 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:02:30 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-dbdc75b9-2c33-4c02-9635-fa3b4ccb9862 tempest-VolumesTransfersTest-1290607760 None] Deleted volume successfully. Jun 03 12:02:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-dbdc75b9-2c33-4c02-9635-fa3b4ccb9862 tempest-VolumesTransfersTest-1290607760 None] Lock "cinder-c34fd9cd-2482-4f4a-b305-1c54f38bacf6-delete_volume" released by "delete_volume" :: held 3.367s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:02:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] Acquiring lock "cinder-00d827b0-3b70-40e0-a29e-aef847f48b1c-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:02:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "cinder-00d827b0-3b70-40e0-a29e-aef847f48b1c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:02:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] Acquiring lock "cinder-quobyte-00d827b0-3b70-40e0-a29e-aef847f48b1c" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:02:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "cinder-quobyte-00d827b0-3b70-40e0-a29e-aef847f48b1c" acquired by "delete_volume" :: waited 0.029s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:02:32 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f04003-7a09-40e9-ad23-2ea25575445c]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:02:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-00d827b0-3b70-40e0-a29e-aef847f48b1c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:32 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-00d827b0-3b70-40e0-a29e-aef847f48b1c Jun 03 12:02:32 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:33 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-00d827b0-3b70-40e0-a29e-aef847f48b1c" returned: 0 in 1.076s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-00d827b0-3b70-40e0-a29e-aef847f48b1c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:33 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-00d827b0-3b70-40e0-a29e-aef847f48b1c Jun 03 12:02:33 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:34 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-00d827b0-3b70-40e0-a29e-aef847f48b1c" returned: 0 in 0.992s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "cinder-quobyte-00d827b0-3b70-40e0-a29e-aef847f48b1c" released by "delete_volume" :: held 2.138s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:02:34 devstack cinder-volume[86724]: WARNING cinder.quota [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2074827774-1851226977 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2074827774-1851226977, it is now deprecated. Please use the default quota class for default quota. Jun 03 12:02:34 devstack cinder-volume[86724]: WARNING cinder.quota [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2074827774-1851226977 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2074827774-1851226977, it is now deprecated. Please use the default quota class for default quota. Jun 03 12:02:34 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] Created reservations ['39dc4a81-891a-4054-b9ad-dac6308e5c9f', '3d7800ec-88e9-489c-8ec4-832727101d8e', '7781adc0-35f3-445b-bc84-e071a143f277', '01246fc6-6110-4b24-a471-c72d67143951'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:02:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:34 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:02:34 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:02:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:34 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:02:34 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:35 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.891s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:35 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:02:35 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] Deleted volume successfully. Jun 03 12:02:35 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-9be99bd7-6083-46ae-bf81-3a145ea2b7cc tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "cinder-00d827b0-3b70-40e0-a29e-aef847f48b1c-delete_volume" released by "delete_volume" :: held 3.415s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:02:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 12:02:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:02:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:02:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:37 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:02:37 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:37 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.990s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:37 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:02:44 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:INSERT=6,cinder:UPDATE=36,cinder:SELECT=17,cinder:DELETE=1 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Flow 'volume_create_manager' (5f458f87-9cd1-47ac-8f00-7b1675a25f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46930518-dbdf-467e-9577-3ec04b69d31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46930518-dbdf-467e-9577-3ec04b69d31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-773195041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0533c5-58a6-4976-9c37-cba23168c2c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc798db85e8b4e5db83c8690e896ee41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:02:45Z,use_quota=True,user_id='6d00b4d83c82495ab81e52222a870780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d6c47b-7d15-4aa5-84f0-c334594461a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d6c47b-7d15-4aa5-84f0-c334594461a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d99f30-b94a-4c38-acfe-104767cc0128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d99f30-b94a-4c38-acfe-104767cc0128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d0533c5-58a6-4976-9c37-cba23168c2c9', 'volume_name': 'volume-5d0533c5-58a6-4976-9c37-cba23168c2c9', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158485c1-9e09-49d0-8be1-7c7e5174abac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158485c1-9e09-49d0-8be1-7c7e5174abac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee7cb73-23d8-4d4b-9f68-07ecd4db42c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:45 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Volume 5d0533c5-58a6-4976-9c37-cba23168c2c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d0533c5-58a6-4976-9c37-cba23168c2c9', 'volume_size': 1} Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-773195041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0533c5-58a6-4976-9c37-cba23168c2c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc798db85e8b4e5db83c8690e896ee41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:02:45Z,use_quota=True,user_id='6d00b4d83c82495ab81e52222a870780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Creating volume 5d0533c5-58a6-4976-9c37-cba23168c2c9 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:02:45 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5d0533c5-58a6-4976-9c37-cba23168c2c9 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:45 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5d0533c5-58a6-4976-9c37-cba23168c2c9 1073741824 Jun 03 12:02:45 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:45 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-106aab9b-7136-4a72-aa71-51dfbb6d7685 req-774d60d2-9dd5-4e5d-8e64-a23d46edf37e tempest-TestInstancesWithCinderVolumes-1308894972 None] Terminate volume connection completed successfully. Jun 03 12:02:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-106aab9b-7136-4a72-aa71-51dfbb6d7685 req-774d60d2-9dd5-4e5d-8e64-a23d46edf37e tempest-TestInstancesWithCinderVolumes-1308894972 None] Deleting attachment 68eca39b-23e5-4df6-b2e2-c5ede8288ed5. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 12:02:46 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:02:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Flow 'volume_create_manager' (15c84806-be9e-440c-91c7-4d921bd1dc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:02:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32dca303-5d7b-48aa-a590-033f202bdfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32dca303-5d7b-48aa-a590-033f202bdfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-546670199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce510bfb-cf75-4f73-a95f-e3715a896b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc798db85e8b4e5db83c8690e896ee41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:02:46Z,use_quota=True,user_id='6d00b4d83c82495ab81e52222a870780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b9c3e7-ae85-4926-b9c4-33eb1b02f17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b9c3e7-ae85-4926-b9c4-33eb1b02f17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d983d2c-881a-45ae-b133-8177bbc60415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d983d2c-881a-45ae-b133-8177bbc60415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce510bfb-cf75-4f73-a95f-e3715a896b01', 'volume_name': 'volume-ce510bfb-cf75-4f73-a95f-e3715a896b01', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb6069c-59da-49d1-84d2-5d3021502e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb6069c-59da-49d1-84d2-5d3021502e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (326ecc60-ebd9-44e0-bc47-88a0a80fa42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:46 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Volume ce510bfb-cf75-4f73-a95f-e3715a896b01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce510bfb-cf75-4f73-a95f-e3715a896b01', 'volume_size': 1} Jun 03 12:02:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:47 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5d0533c5-58a6-4976-9c37-cba23168c2c9 1073741824" returned: 0 in 1.507s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5d0533c5-58a6-4976-9c37-cba23168c2c9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:47 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5d0533c5-58a6-4976-9c37-cba23168c2c9 Jun 03 12:02:47 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:47 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5d0533c5-58a6-4976-9c37-cba23168c2c9" returned: 0 in 0.839s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] <== create_volume: return (2429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:02:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.438s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.612s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-546670199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce510bfb-cf75-4f73-a95f-e3715a896b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc798db85e8b4e5db83c8690e896ee41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:02:46Z,use_quota=True,user_id='6d00b4d83c82495ab81e52222a870780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:02:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Creating volume ce510bfb-cf75-4f73-a95f-e3715a896b01 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:02:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:02:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:02:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:02:47 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:02:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ce510bfb-cf75-4f73-a95f-e3715a896b01 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee7cb73-23d8-4d4b-9f68-07ecd4db42c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d0533c5-58a6-4976-9c37-cba23168c2c9', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4588702-a300-458f-87d4-fc2a08b5aead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:47 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ce510bfb-cf75-4f73-a95f-e3715a896b01 1073741824 Jun 03 12:02:47 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:48 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Volume volume-5d0533c5-58a6-4976-9c37-cba23168c2c9 (5d0533c5-58a6-4976-9c37-cba23168c2c9): created successfully Jun 03 12:02:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4588702-a300-458f-87d4-fc2a08b5aead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Flow 'volume_create_manager' (5f458f87-9cd1-47ac-8f00-7b1675a25f4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:02:48 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-01db6e58-4a61-4b6c-beb9-4a25d77ec863 tempest-TestServerVolumeAttachmentScenario-946377902 None] Created volume successfully. Jun 03 12:02:49 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ce510bfb-cf75-4f73-a95f-e3715a896b01 1073741824" returned: 0 in 1.199s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ce510bfb-cf75-4f73-a95f-e3715a896b01 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:49 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ce510bfb-cf75-4f73-a95f-e3715a896b01 Jun 03 12:02:49 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] Acquiring lock "cinder-601bad4b-3030-4bf0-8d1d-85bab4b1768c-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:02:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "cinder-601bad4b-3030-4bf0-8d1d-85bab4b1768c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:02:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] Acquiring lock "cinder-quobyte-601bad4b-3030-4bf0-8d1d-85bab4b1768c" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:02:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "cinder-quobyte-601bad4b-3030-4bf0-8d1d-85bab4b1768c" acquired by "delete_volume" :: waited 0.027s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:02:49 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[794871b0-94ab-4b9e-a2d1-cb852d3e5448]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:02:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:49 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c Jun 03 12:02:49 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:50 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ce510bfb-cf75-4f73-a95f-e3715a896b01" returned: 0 in 1.056s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:50 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] <== create_volume: return (2338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:02:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.341s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (326ecc60-ebd9-44e0-bc47-88a0a80fa42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce510bfb-cf75-4f73-a95f-e3715a896b01', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c246fed-11b8-4ddc-b419-ad5407ddf428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:50 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Volume volume-ce510bfb-cf75-4f73-a95f-e3715a896b01 (ce510bfb-cf75-4f73-a95f-e3715a896b01): created successfully Jun 03 12:02:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c246fed-11b8-4ddc-b419-ad5407ddf428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Flow 'volume_create_manager' (15c84806-be9e-440c-91c7-4d921bd1dc2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:02:50 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-b8ada118-f5fc-4e44-bbb2-af7ba8cefbca tempest-TestServerVolumeAttachmentScenario-946377902 None] Created volume successfully. Jun 03 12:02:50 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c" returned: 0 in 1.039s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:50 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c Jun 03 12:02:50 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:51 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c" returned: 1 in 1.058s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:02:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:51 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c Jun 03 12:02:51 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:51 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:02:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Flow 'volume_create_manager' (45145f35-ec77-433c-a492-213c9559b595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:02:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f43b672-85ae-409c-8056-f243b503550a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f43b672-85ae-409c-8056-f243b503550a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-703421259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5206fbb-6f03-47fc-bcac-b1b174c338e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d3413e6f904628bb609857f5e366bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:02:52Z,use_quota=True,user_id='20ce95c95b7844318e90555509d1dacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5b388e-6c85-41d7-8583-3eee1410e80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5b388e-6c85-41d7-8583-3eee1410e80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c60be11b-0911-4dde-80ae-2e3acf42bf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c60be11b-0911-4dde-80ae-2e3acf42bf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5206fbb-6f03-47fc-bcac-b1b174c338e4', 'volume_name': 'volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b95753-4063-46b4-b1e8-e993e50327a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b95753-4063-46b4-b1e8-e993e50327a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c972ed6d-7cfc-48be-a022-63878bf34800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:52 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Volume c5206fbb-6f03-47fc-bcac-b1b174c338e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4', 'volume_size': 1} Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-703421259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5206fbb-6f03-47fc-bcac-b1b174c338e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d3413e6f904628bb609857f5e366bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:02:52Z,use_quota=True,user_id='20ce95c95b7844318e90555509d1dacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Creating volume c5206fbb-6f03-47fc-bcac-b1b174c338e4 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:02:52 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:52 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 1073741824 Jun 03 12:02:52 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:52 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-601bad4b-3030-4bf0-8d1d-85bab4b1768c" returned: 0 in 0.732s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "cinder-quobyte-601bad4b-3030-4bf0-8d1d-85bab4b1768c" released by "delete_volume" :: held 2.957s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:02:52 devstack cinder-volume[86724]: WARNING cinder.quota [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-615455278-356519407 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-615455278-356519407, it is now deprecated. Please use the default quota class for default quota. Jun 03 12:02:52 devstack cinder-volume[86724]: WARNING cinder.quota [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-615455278-356519407 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-615455278-356519407, it is now deprecated. Please use the default quota class for default quota. Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] Created reservations ['0161d468-7beb-412f-acbe-f6a25a8569c5', '091eb498-4db6-42d6-a977-59291e801555', 'f8d18e30-d759-48fe-8803-ee7b8022195c', '1a51ac7c-6f12-47ac-a741-f19e0527d50b'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:52 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:02:52 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:53 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 1073741824" returned: 0 in 1.354s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:53 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 Jun 03 12:02:53 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:54 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.329s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:54 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:02:54 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] Deleted volume successfully. Jun 03 12:02:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ac13086c-997e-487f-ba11-007d252fd9ad tempest-TestInstancesWithCinderVolumes-1308894972 None] Lock "cinder-601bad4b-3030-4bf0-8d1d-85bab4b1768c-delete_volume" released by "delete_volume" :: held 4.648s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:02:54 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4" returned: 0 in 0.949s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:54 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] <== create_volume: return (2398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:02:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.400s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c972ed6d-7cfc-48be-a022-63878bf34800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839bb897-d6e2-4cad-8c88-27d66350ae80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:02:54 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Volume volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 (c5206fbb-6f03-47fc-bcac-b1b174c338e4): created successfully Jun 03 12:02:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839bb897-d6e2-4cad-8c88-27d66350ae80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:02:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Flow 'volume_create_manager' (45145f35-ec77-433c-a492-213c9559b595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:02:54 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-5dd2cfb3-fa5e-4403-a041-48a8dacf94ee tempest-VolumesActionsTest-43259975 None] Created volume successfully. Jun 03 12:02:54 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-6fc175e7-4bfa-472f-ab60-006677904bb4 req-07fb8a02-d34c-4f7e-80f3-b11483a2454a tempest-TestMinimumBasicScenario-49936155 None] Terminate volume connection completed successfully. Jun 03 12:02:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-6fc175e7-4bfa-472f-ab60-006677904bb4 req-07fb8a02-d34c-4f7e-80f3-b11483a2454a tempest-TestMinimumBasicScenario-49936155 None] Deleting attachment 60eb8bc9-525c-4476-b112-169dfadd7f62. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 12:02:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-080f2c1f-e0d8-4610-ba86-204c5efc92ef tempest-TestMinimumBasicScenario-49936155 None] Acquiring lock "cinder-c0be97ad-fbe8-4111-b6ac-74b919ec683c-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:02:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-080f2c1f-e0d8-4610-ba86-204c5efc92ef tempest-TestMinimumBasicScenario-49936155 None] Lock "cinder-c0be97ad-fbe8-4111-b6ac-74b919ec683c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:02:57 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-080f2c1f-e0d8-4610-ba86-204c5efc92ef tempest-TestMinimumBasicScenario-49936155 None] Acquiring lock "cinder-quobyte-c0be97ad-fbe8-4111-b6ac-74b919ec683c" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:02:57 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-080f2c1f-e0d8-4610-ba86-204c5efc92ef tempest-TestMinimumBasicScenario-49936155 None] Lock "cinder-quobyte-c0be97ad-fbe8-4111-b6ac-74b919ec683c" acquired by "delete_volume" :: waited 0.024s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:02:57 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6441b8-472c-40d8-b7e6-778f20cc4d7a]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:02:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-080f2c1f-e0d8-4610-ba86-204c5efc92ef tempest-TestMinimumBasicScenario-49936155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0be97ad-fbe8-4111-b6ac-74b919ec683c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:57 devstack sudo[98994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0be97ad-fbe8-4111-b6ac-74b919ec683c Jun 03 12:02:57 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:58 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-080f2c1f-e0d8-4610-ba86-204c5efc92ef tempest-TestMinimumBasicScenario-49936155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0be97ad-fbe8-4111-b6ac-74b919ec683c" returned: 0 in 0.967s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-080f2c1f-e0d8-4610-ba86-204c5efc92ef tempest-TestMinimumBasicScenario-49936155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0be97ad-fbe8-4111-b6ac-74b919ec683c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:58 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0be97ad-fbe8-4111-b6ac-74b919ec683c Jun 03 12:02:58 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:58 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-080f2c1f-e0d8-4610-ba86-204c5efc92ef tempest-TestMinimumBasicScenario-49936155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0be97ad-fbe8-4111-b6ac-74b919ec683c" returned: 0 in 0.724s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:58 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-080f2c1f-e0d8-4610-ba86-204c5efc92ef tempest-TestMinimumBasicScenario-49936155 None] Lock "cinder-quobyte-c0be97ad-fbe8-4111-b6ac-74b919ec683c" released by "delete_volume" :: held 1.777s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:02:58 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-080f2c1f-e0d8-4610-ba86-204c5efc92ef tempest-TestMinimumBasicScenario-49936155 None] Created reservations ['771998bc-b7ff-4f38-a827-5893d01b8107', 'e55da27c-17d6-4c0d-bae0-579512c85725', 'cd2c8495-383e-43fb-a1f0-2a24f93f4eae', '96187f75-5eed-4d91-ab31-b0eb7f3215b2'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:02:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-080f2c1f-e0d8-4610-ba86-204c5efc92ef tempest-TestMinimumBasicScenario-49936155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:02:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-080f2c1f-e0d8-4610-ba86-204c5efc92ef tempest-TestMinimumBasicScenario-49936155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:02:58 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-080f2c1f-e0d8-4610-ba86-204c5efc92ef tempest-TestMinimumBasicScenario-49936155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:02:58 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-080f2c1f-e0d8-4610-ba86-204c5efc92ef tempest-TestMinimumBasicScenario-49936155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:02:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-080f2c1f-e0d8-4610-ba86-204c5efc92ef tempest-TestMinimumBasicScenario-49936155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:02:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-080f2c1f-e0d8-4610-ba86-204c5efc92ef tempest-TestMinimumBasicScenario-49936155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:02:59 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:02:59 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:02:59 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Jun 03 12:02:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-080f2c1f-e0d8-4610-ba86-204c5efc92ef tempest-TestMinimumBasicScenario-49936155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.902s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:02:59 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-080f2c1f-e0d8-4610-ba86-204c5efc92ef tempest-TestMinimumBasicScenario-49936155 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:02:59 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-080f2c1f-e0d8-4610-ba86-204c5efc92ef tempest-TestMinimumBasicScenario-49936155 None] Deleted volume successfully. Jun 03 12:02:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-080f2c1f-e0d8-4610-ba86-204c5efc92ef tempest-TestMinimumBasicScenario-49936155 None] Lock "cinder-c0be97ad-fbe8-4111-b6ac-74b919ec683c-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:03:08 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:UPDATE=27,cinder:SELECT=16,cinder:DELETE=2,cinder:INSERT=7 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:03:09 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=39,cinder:UPDATE=47,cinder:INSERT=12,cinder:DELETE=6 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:03:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b8e83048-2c57-419f-8eb5-87f968ce18f0 tempest-VolumesActionsTest-43259975 None] Acquiring lock "cinder-c5206fbb-6f03-47fc-bcac-b1b174c338e4" by "attach_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:03:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b8e83048-2c57-419f-8eb5-87f968ce18f0 tempest-VolumesActionsTest-43259975 None] Lock "cinder-c5206fbb-6f03-47fc-bcac-b1b174c338e4" acquired by "attach_volume" :: waited 0.025s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:03:26 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-b8e83048-2c57-419f-8eb5-87f968ce18f0 tempest-VolumesActionsTest-43259975 None] Attaching volume c5206fbb-6f03-47fc-bcac-b1b174c338e4 to instance d8515626-774a-49fc-9967-bb030ce1f8d0 at mountpoint /dev/vdb on host None. Jun 03 12:03:26 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-b8e83048-2c57-419f-8eb5-87f968ce18f0 tempest-VolumesActionsTest-43259975 None] Attach volume completed successfully. Jun 03 12:03:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b8e83048-2c57-419f-8eb5-87f968ce18f0 tempest-VolumesActionsTest-43259975 None] Lock "cinder-c5206fbb-6f03-47fc-bcac-b1b174c338e4" released by "attach_volume" :: held 0.114s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:03:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-44c21956-a2fc-4060-bc21-28928808c915 tempest-VolumesActionsTest-43259975 None] Acquiring lock "cinder-c5206fbb-6f03-47fc-bcac-b1b174c338e4-detach_volume" by "detach_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:03:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-44c21956-a2fc-4060-bc21-28928808c915 tempest-VolumesActionsTest-43259975 None] Lock "cinder-c5206fbb-6f03-47fc-bcac-b1b174c338e4-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:03:27 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-44c21956-a2fc-4060-bc21-28928808c915 tempest-VolumesActionsTest-43259975 None] Detaching volume c5206fbb-6f03-47fc-bcac-b1b174c338e4 from instance d8515626-774a-49fc-9967-bb030ce1f8d0. Jun 03 12:03:27 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-44c21956-a2fc-4060-bc21-28928808c915 tempest-VolumesActionsTest-43259975 None] Detach volume completed successfully. Jun 03 12:03:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-44c21956-a2fc-4060-bc21-28928808c915 tempest-VolumesActionsTest-43259975 None] Lock "cinder-c5206fbb-6f03-47fc-bcac-b1b174c338e4-detach_volume" released by "detach_volume" :: held 0.128s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:03:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 12:03:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:03:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:03:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:03:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:03:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:03:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:03:37 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:03:37 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:03:37 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Jun 03 12:03:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.683s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:03:37 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:03:37 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:INSERT=1,cinder:SELECT=6,cinder:UPDATE=4 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:03:37 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:03:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-0e5100f6-1a15-4a9c-bc5c-44fff5494b67 req-34cbd951-4638-4aa1-b6b8-5eec5448e425 tempest-TestServerVolumeAttachmentScenario-946377902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:03:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-0e5100f6-1a15-4a9c-bc5c-44fff5494b67 req-34cbd951-4638-4aa1-b6b8-5eec5448e425 tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:03:41 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3399b86d-9de1-4295-a054-f1507914d51e]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:03:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-0e5100f6-1a15-4a9c-bc5c-44fff5494b67 req-34cbd951-4638-4aa1-b6b8-5eec5448e425 tempest-TestServerVolumeAttachmentScenario-946377902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5d0533c5-58a6-4976-9c37-cba23168c2c9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:03:42 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5d0533c5-58a6-4976-9c37-cba23168c2c9 Jun 03 12:03:42 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:03:43 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Jun 03 12:03:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-0e5100f6-1a15-4a9c-bc5c-44fff5494b67 req-34cbd951-4638-4aa1-b6b8-5eec5448e425 tempest-TestServerVolumeAttachmentScenario-946377902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5d0533c5-58a6-4976-9c37-cba23168c2c9" returned: 0 in 1.134s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:03:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-0e5100f6-1a15-4a9c-bc5c-44fff5494b67 req-34cbd951-4638-4aa1-b6b8-5eec5448e425 tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.180s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:03:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-0e5100f6-1a15-4a9c-bc5c-44fff5494b67 req-34cbd951-4638-4aa1-b6b8-5eec5448e425 tempest-TestServerVolumeAttachmentScenario-946377902 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-5d0533c5-58a6-4976-9c37-cba23168c2c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ae02f56-e3c6-4955-8721-b7f227ade219', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 12:03:43 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-0e5100f6-1a15-4a9c-bc5c-44fff5494b67 req-34cbd951-4638-4aa1-b6b8-5eec5448e425 tempest-TestServerVolumeAttachmentScenario-946377902 None] attachment_update completed successfully. Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Flow 'volume_create_manager' (6aaee14b-e426-4954-8b96-ed81489fe276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9785f8d2-72a5-4749-adf3-51882467e371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9785f8d2-72a5-4749-adf3-51882467e371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-63581901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea71870-0942-46ae-a0e0-7ad16892a113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79519871caf4d2ba9fde87a46746b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:03:47Z,use_quota=True,user_id='6c827d1857e14b91a804b06cfa0b70da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1964be-4934-42b4-8c8f-0c1e375dbdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1964be-4934-42b4-8c8f-0c1e375dbdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eedf384b-2fca-4de1-b57d-e559f2674346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eedf384b-2fca-4de1-b57d-e559f2674346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ea71870-0942-46ae-a0e0-7ad16892a113', 'volume_name': 'volume-8ea71870-0942-46ae-a0e0-7ad16892a113', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd99099-541d-44ec-bb0a-02ea0c374c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd99099-541d-44ec-bb0a-02ea0c374c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1eb84d-f576-42c5-9d8d-eeefbac8d046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:03:47 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Volume 8ea71870-0942-46ae-a0e0-7ad16892a113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ea71870-0942-46ae-a0e0-7ad16892a113', 'volume_size': 1} Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-63581901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea71870-0942-46ae-a0e0-7ad16892a113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79519871caf4d2ba9fde87a46746b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:03:47Z,use_quota=True,user_id='6c827d1857e14b91a804b06cfa0b70da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Creating volume 8ea71870-0942-46ae-a0e0-7ad16892a113 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:03:47 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:03:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:03:47 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 1073741824 Jun 03 12:03:47 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:03:48 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Jun 03 12:03:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 1073741824" returned: 0 in 1.048s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:03:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:03:48 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 Jun 03 12:03:48 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:03:49 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jun 03 12:03:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113" returned: 0 in 1.139s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:03:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] <== create_volume: return (2266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:03:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.273s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:03:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1eb84d-f576-42c5-9d8d-eeefbac8d046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ea71870-0942-46ae-a0e0-7ad16892a113', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:03:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6fa5b6-9a56-40c3-bfd1-d12c7714c151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:03:49 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Volume volume-8ea71870-0942-46ae-a0e0-7ad16892a113 (8ea71870-0942-46ae-a0e0-7ad16892a113): created successfully Jun 03 12:03:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6fa5b6-9a56-40c3-bfd1-d12c7714c151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:03:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Flow 'volume_create_manager' (6aaee14b-e426-4954-8b96-ed81489fe276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:03:49 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c3d15416-8678-4fe0-9f62-d13b8956eb4d tempest-TestStampPattern-576404759 None] Created volume successfully. Jun 03 12:03:59 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:03:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Flow 'volume_create_manager' (d1b0609b-5f34-4dc7-814e-741e036377ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:03:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d0f14a-1a7a-444f-90a4-3619caabd86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:03:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d0f14a-1a7a-444f-90a4-3619caabd86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-152006183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=135f9f69-b862-408e-968f-21bc59fa6d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f6696ef1cc48d79cd8cff762fde0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:03:59Z,use_quota=True,user_id='aa1dd13c01f7431d97cda3dc5992fbde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:03:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b364d9-a609-4a5a-b091-b7446fa10386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:03:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b364d9-a609-4a5a-b091-b7446fa10386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:03:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8eed52-7922-401f-a9c9-8629ff6bbf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:03:59 devstack cinder-volume[86724]: DEBUG cinder.image.glance [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Creating Keystone auth plugin from conf {{(pid=86724) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 03 12:03:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8eed52-7922-401f-a9c9-8629ff6bbf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '135f9f69-b862-408e-968f-21bc59fa6d96', 'volume_name': 'volume-135f9f69-b862-408e-968f-21bc59fa6d96', 'volume_size': 1, 'image_id': '0249897e-120c-42bb-b1a8-f517317c1907', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e70522cb7d6245e7970314b42bb711e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0249897e-120c-42bb-b1a8-f517317c1907', 'created_at': datetime.datetime(2026, 6, 3, 9, 43, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 9, 43, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0249897e-120c-42bb-b1a8-f517317c1907/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:03:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22328944-114a-4300-a7e5-511da735ae87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:03:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22328944-114a-4300-a7e5-511da735ae87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:03:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2504e5ad-25fb-4ed0-95d9-4ccf251615a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:03:59 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Volume 135f9f69-b862-408e-968f-21bc59fa6d96: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-135f9f69-b862-408e-968f-21bc59fa6d96', 'volume_size': 1, 'image_id': '0249897e-120c-42bb-b1a8-f517317c1907', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e70522cb7d6245e7970314b42bb711e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0249897e-120c-42bb-b1a8-f517317c1907', 'created_at': datetime.datetime(2026, 6, 3, 9, 43, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 9, 43, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0249897e-120c-42bb-b1a8-f517317c1907/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 03 12:03:59 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Trying to clone 135f9f69-b862-408e-968f-21bc59fa6d96 from image 0249897e-120c-42bb-b1a8-f517317c1907 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}]). {{(pid=86724) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 03 12:04:00 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_9eizmu2vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 03 12:04:00 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Image download 20.69 MB at 20.69 MB/s Jun 03 12:04:00 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[299fa770-a6c6-40b4-96c5-1e280076a331]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:04:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_9eizmu2vdevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-511c9de8-557f-44c7-9c01-6993ef98f4a3 req-cfc47b67-2142-4ce0-a2e7-ca51d418be2e tempest-TestServerVolumeAttachmentScenario-946377902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:04:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-511c9de8-557f-44c7-9c01-6993ef98f4a3 req-cfc47b67-2142-4ce0-a2e7-ca51d418be2e tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:04:00 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e024ade-2fd5-43fd-a7d8-487a85cea510]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:04:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-511c9de8-557f-44c7-9c01-6993ef98f4a3 req-cfc47b67-2142-4ce0-a2e7-ca51d418be2e tempest-TestServerVolumeAttachmentScenario-946377902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ce510bfb-cf75-4f73-a95f-e3715a896b01 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:00 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_9eizmu2vdevstack@QuobyteHD Jun 03 12:04:00 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:00 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ce510bfb-cf75-4f73-a95f-e3715a896b01 Jun 03 12:04:00 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:02 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_9eizmu2vdevstack@QuobyteHD" returned: 0 in 1.399s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:02 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Temporary image 0249897e-120c-42bb-b1a8-f517317c1907 is fetched for user aa1dd13c01f7431d97cda3dc5992fbde. {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 03 12:04:02 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-511c9de8-557f-44c7-9c01-6993ef98f4a3 req-cfc47b67-2142-4ce0-a2e7-ca51d418be2e tempest-TestServerVolumeAttachmentScenario-946377902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ce510bfb-cf75-4f73-a95f-e3715a896b01" returned: 0 in 1.341s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-511c9de8-557f-44c7-9c01-6993ef98f4a3 req-cfc47b67-2142-4ce0-a2e7-ca51d418be2e tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.409s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:04:02 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[919783f7-38f5-4b33-8f8b-5d6ef5651a70]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:04:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_9eizmu2vdevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-511c9de8-557f-44c7-9c01-6993ef98f4a3 req-cfc47b67-2142-4ce0-a2e7-ca51d418be2e tempest-TestServerVolumeAttachmentScenario-946377902 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-ce510bfb-cf75-4f73-a95f-e3715a896b01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f9eef73-8f52-4929-be55-5c06e31a3918', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 12:04:02 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-511c9de8-557f-44c7-9c01-6993ef98f4a3 req-cfc47b67-2142-4ce0-a2e7-ca51d418be2e tempest-TestServerVolumeAttachmentScenario-946377902 None] attachment_update completed successfully. Jun 03 12:04:02 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_9eizmu2vdevstack@QuobyteHD Jun 03 12:04:02 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:03 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_9eizmu2vdevstack@QuobyteHD" returned: 0 in 1.309s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:04:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:04:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-152006183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=135f9f69-b862-408e-968f-21bc59fa6d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f6696ef1cc48d79cd8cff762fde0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:03:59Z,use_quota=True,user_id='aa1dd13c01f7431d97cda3dc5992fbde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:04:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Creating volume 135f9f69-b862-408e-968f-21bc59fa6d96 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:04:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:04:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:04:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:04:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:04:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:04:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:04:03 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:04:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:03 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 1073741824 Jun 03 12:04:03 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:04 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1849d95d-45fb-43b1-88e4-5ca11e2ea69f tempest-VolumesActionsTest-43259975 None] Acquiring lock "cinder-c5206fbb-6f03-47fc-bcac-b1b174c338e4" by "attach_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:04:04 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1849d95d-45fb-43b1-88e4-5ca11e2ea69f tempest-VolumesActionsTest-43259975 None] Lock "cinder-c5206fbb-6f03-47fc-bcac-b1b174c338e4" acquired by "attach_volume" :: waited 0.045s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:04:04 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-1849d95d-45fb-43b1-88e4-5ca11e2ea69f tempest-VolumesActionsTest-43259975 None] Attaching volume c5206fbb-6f03-47fc-bcac-b1b174c338e4 to instance a68f1635-662f-42b0-8a1e-33469dff7290 at mountpoint /dev/vdb on host None. Jun 03 12:04:04 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-1849d95d-45fb-43b1-88e4-5ca11e2ea69f tempest-VolumesActionsTest-43259975 None] Attach volume completed successfully. Jun 03 12:04:04 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-1849d95d-45fb-43b1-88e4-5ca11e2ea69f tempest-VolumesActionsTest-43259975 None] Lock "cinder-c5206fbb-6f03-47fc-bcac-b1b174c338e4" released by "attach_volume" :: held 0.191s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:04:04 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a3b08931-66cf-4698-b1ef-ec386b3d7bce tempest-VolumesActionsTest-43259975 None] Acquiring lock "cinder-c5206fbb-6f03-47fc-bcac-b1b174c338e4-detach_volume" by "detach_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:04:04 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a3b08931-66cf-4698-b1ef-ec386b3d7bce tempest-VolumesActionsTest-43259975 None] Lock "cinder-c5206fbb-6f03-47fc-bcac-b1b174c338e4-detach_volume" acquired by "detach_volume" :: waited 0.061s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:04:05 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a3b08931-66cf-4698-b1ef-ec386b3d7bce tempest-VolumesActionsTest-43259975 None] Detaching volume c5206fbb-6f03-47fc-bcac-b1b174c338e4 from instance a68f1635-662f-42b0-8a1e-33469dff7290. Jun 03 12:04:05 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a3b08931-66cf-4698-b1ef-ec386b3d7bce tempest-VolumesActionsTest-43259975 None] Detach volume completed successfully. Jun 03 12:04:05 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a3b08931-66cf-4698-b1ef-ec386b3d7bce tempest-VolumesActionsTest-43259975 None] Lock "cinder-c5206fbb-6f03-47fc-bcac-b1b174c338e4-detach_volume" released by "detach_volume" :: held 0.140s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:04:05 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 1073741824" returned: 0 in 1.824s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:05 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 Jun 03 12:04:05 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:06 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96" returned: 0 in 0.880s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] <== create_volume: return (2788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:04:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.801s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:04:06 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Attempting download of 0249897e-120c-42bb-b1a8-f517317c1907 ((None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}])) to volume 135f9f69-b862-408e-968f-21bc59fa6d96. {{(pid=86724) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 03 12:04:06 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de5ffae-f619-4d92-8a4f-1b5cc3881086]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:04:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_bus6y0ng {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:06 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_bus6y0ng Jun 03 12:04:06 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:07 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_bus6y0ng" returned: 0 in 1.644s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_bus6y0ng {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:08 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_bus6y0ng Jun 03 12:04:08 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:09 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_bus6y0ng" returned: 1 in 1.265s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0249897e-120c-42bb-b1a8-f517317c1907_bus6y0ng' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:04:09 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e64a06-51eb-4119-b258-7deb3cd4a2a8]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:04:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_9eizmu2vdevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:09 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_9eizmu2vdevstack@QuobyteHD Jun 03 12:04:09 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:09 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-898fcf20-704f-4749-9522-a14c8896643d req-b096fc95-ce00-4a5c-a10a-6a17787e969e tempest-TestServerVolumeAttachmentScenario-946377902 None] Terminate volume connection completed successfully. Jun 03 12:04:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-898fcf20-704f-4749-9522-a14c8896643d req-b096fc95-ce00-4a5c-a10a-6a17787e969e tempest-TestServerVolumeAttachmentScenario-946377902 None] Deleting attachment 0f9eef73-8f52-4929-be55-5c06e31a3918. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 12:04:10 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_9eizmu2vdevstack@QuobyteHD" returned: 0 in 1.409s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:10 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] 0249897e-120c-42bb-b1a8-f517317c1907 was qcow2, converting to raw {{(pid=86724) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 03 12:04:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_9eizmu2vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:10 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_9eizmu2vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 Jun 03 12:04:10 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:13 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_9eizmu2vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96" returned: 0 in 2.337s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:13 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0249897e-120c-42bb-b1a8-f517317c1907_9eizmu2vdevstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 12:04:13 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Converted 112.00 MB image at 47.91 MB/s Jun 03 12:04:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:13 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 1G Jun 03 12:04:13 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:13 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-7cca7d51-5efb-4bd5-aa38-b5ab6592e232 req-8a73afda-c82f-4f1c-a3f7-f7219f0f669e tempest-TestServerVolumeAttachmentScenario-946377902 None] Terminate volume connection completed successfully. Jun 03 12:04:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-7cca7d51-5efb-4bd5-aa38-b5ab6592e232 req-8a73afda-c82f-4f1c-a3f7-f7219f0f669e tempest-TestServerVolumeAttachmentScenario-946377902 None] Deleting attachment 5ae02f56-e3c6-4955-8721-b7f227ade219. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 12:04:13 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 1G" returned: 0 in 0.863s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:13 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3557766f-bb99-4a87-b7b3-581bbc3bd155]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:04:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:14 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 Jun 03 12:04:14 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:14 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96" returned: 0 in 0.929s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:15 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 Jun 03 12:04:15 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c4c3adc4-ecb6-472a-b216-7073201b2058 tempest-VolumesActionsTest-43259975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:04:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c4c3adc4-ecb6-472a-b216-7073201b2058 tempest-VolumesActionsTest-43259975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:04:15 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bc6cc6-f0d5-4aca-bd40-8513c1e1035f]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:04:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c4c3adc4-ecb6-472a-b216-7073201b2058 tempest-VolumesActionsTest-43259975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:15 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96" returned: 1 in 0.764s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:04:15 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Downloaded image 0249897e-120c-42bb-b1a8-f517317c1907 ((None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}])) to volume 135f9f69-b862-408e-968f-21bc59fa6d96 successfully. {{(pid=86724) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 03 12:04:15 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Temporary image 0249897e-120c-42bb-b1a8-f517317c1907 for user aa1dd13c01f7431d97cda3dc5992fbde is deleted. {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 03 12:04:15 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Marking volume 135f9f69-b862-408e-968f-21bc59fa6d96 as bootable. {{(pid=86724) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 03 12:04:15 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 Jun 03 12:04:15 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:15 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Copying metadata from image 0249897e-120c-42bb-b1a8-f517317c1907 to 135f9f69-b862-408e-968f-21bc59fa6d96. {{(pid=86724) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 03 12:04:15 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Creating volume glance metadata for volume 135f9f69-b862-408e-968f-21bc59fa6d96 backed by image 0249897e-120c-42bb-b1a8-f517317c1907 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0249897e-120c-42bb-b1a8-f517317c1907', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86724) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 03 12:04:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2504e5ad-25fb-4ed0-95d9-4ccf251615a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-135f9f69-b862-408e-968f-21bc59fa6d96', 'volume_size': 1, 'image_id': '0249897e-120c-42bb-b1a8-f517317c1907', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0249897e-120c-42bb-b1a8-f517317c1907', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e70522cb7d6245e7970314b42bb711e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0249897e-120c-42bb-b1a8-f517317c1907', 'created_at': datetime.datetime(2026, 6, 3, 9, 43, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 9, 43, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0249897e-120c-42bb-b1a8-f517317c1907/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14015e4-ef86-4e49-9152-5e55eb28c622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:15 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Volume volume-135f9f69-b862-408e-968f-21bc59fa6d96 (135f9f69-b862-408e-968f-21bc59fa6d96): created successfully Jun 03 12:04:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14015e4-ef86-4e49-9152-5e55eb28c622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Flow 'volume_create_manager' (d1b0609b-5f34-4dc7-814e-741e036377ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:04:15 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c7c2694d-7843-49e4-9202-fad9f3e44435 tempest-TestShelveInstance-1271863328 None] Created volume successfully. Jun 03 12:04:16 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c4c3adc4-ecb6-472a-b216-7073201b2058 tempest-VolumesActionsTest-43259975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4" returned: 0 in 0.915s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:16 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[120403d6-d833-4f60-bb43-582dcd40076b]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:04:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c4c3adc4-ecb6-472a-b216-7073201b2058 tempest-VolumesActionsTest-43259975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:16 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 Jun 03 12:04:16 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:17 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c4c3adc4-ecb6-472a-b216-7073201b2058 tempest-VolumesActionsTest-43259975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4" returned: 0 in 1.042s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c4c3adc4-ecb6-472a-b216-7073201b2058 tempest-VolumesActionsTest-43259975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 /opt/stack/data/cinder/conversion/c5206fbb-6f03-47fc-bcac-b1b174c338e4.temp_image.2435c15a-8f1e-4243-8656-a9b027d8ff6dlatlzf1m.img {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:17 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 /opt/stack/data/cinder/conversion/c5206fbb-6f03-47fc-bcac-b1b174c338e4.temp_image.2435c15a-8f1e-4243-8656-a9b027d8ff6dlatlzf1m.img Jun 03 12:04:17 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:23 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c4c3adc4-ecb6-472a-b216-7073201b2058 tempest-VolumesActionsTest-43259975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 /opt/stack/data/cinder/conversion/c5206fbb-6f03-47fc-bcac-b1b174c338e4.temp_image.2435c15a-8f1e-4243-8656-a9b027d8ff6dlatlzf1m.img" returned: 0 in 6.074s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:23 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba822ae-f0b3-4539-bb9e-30135a5051d0]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:04:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c4c3adc4-ecb6-472a-b216-7073201b2058 tempest-VolumesActionsTest-43259975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:23 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 Jun 03 12:04:23 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:24 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c4c3adc4-ecb6-472a-b216-7073201b2058 tempest-VolumesActionsTest-43259975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4" returned: 0 in 1.037s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:24 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-c4c3adc4-ecb6-472a-b216-7073201b2058 tempest-VolumesActionsTest-43259975 None] Image conversion details: src /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/conversion/c5206fbb-6f03-47fc-bcac-b1b174c338e4.temp_image.2435c15a-8f1e-4243-8656-a9b027d8ff6dlatlzf1m.img {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 12:04:24 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-c4c3adc4-ecb6-472a-b216-7073201b2058 tempest-VolumesActionsTest-43259975 None] Converted 1024.00 MB image at 168.56 MB/s Jun 03 12:04:24 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-c4c3adc4-ecb6-472a-b216-7073201b2058 tempest-VolumesActionsTest-43259975 None] 2435c15a-8f1e-4243-8656-a9b027d8ff6d was raw, no need to convert to raw {{(pid=86724) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Jun 03 12:04:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-dcfd7cc3-b019-4a2c-a565-9a7ecebcc5ba req-2d691017-2f1a-4866-8076-a4759cee9888 tempest-TestShelveInstance-1271863328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:04:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8fd454b9-db81-4715-a89d-1e18b4739ffa tempest-TestServerVolumeAttachmentScenario-946377902 None] Acquiring lock "cinder-ce510bfb-cf75-4f73-a95f-e3715a896b01-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:04:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8fd454b9-db81-4715-a89d-1e18b4739ffa tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "cinder-ce510bfb-cf75-4f73-a95f-e3715a896b01-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:04:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8fd454b9-db81-4715-a89d-1e18b4739ffa tempest-TestServerVolumeAttachmentScenario-946377902 None] Acquiring lock "cinder-quobyte-ce510bfb-cf75-4f73-a95f-e3715a896b01" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:04:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8fd454b9-db81-4715-a89d-1e18b4739ffa tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "cinder-quobyte-ce510bfb-cf75-4f73-a95f-e3715a896b01" acquired by "delete_volume" :: waited 0.020s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:04:27 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5b9cf6-83bc-4c36-8af0-38c3a930b290]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:04:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8fd454b9-db81-4715-a89d-1e18b4739ffa tempest-TestServerVolumeAttachmentScenario-946377902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ce510bfb-cf75-4f73-a95f-e3715a896b01 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:27 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ce510bfb-cf75-4f73-a95f-e3715a896b01 Jun 03 12:04:27 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:28 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8fd454b9-db81-4715-a89d-1e18b4739ffa tempest-TestServerVolumeAttachmentScenario-946377902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ce510bfb-cf75-4f73-a95f-e3715a896b01" returned: 0 in 1.052s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8fd454b9-db81-4715-a89d-1e18b4739ffa tempest-TestServerVolumeAttachmentScenario-946377902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ce510bfb-cf75-4f73-a95f-e3715a896b01 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:28 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ce510bfb-cf75-4f73-a95f-e3715a896b01 Jun 03 12:04:28 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:29 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8fd454b9-db81-4715-a89d-1e18b4739ffa tempest-TestServerVolumeAttachmentScenario-946377902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ce510bfb-cf75-4f73-a95f-e3715a896b01" returned: 0 in 0.687s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:29 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8fd454b9-db81-4715-a89d-1e18b4739ffa tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "cinder-quobyte-ce510bfb-cf75-4f73-a95f-e3715a896b01" released by "delete_volume" :: held 1.792s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:04:29 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-8fd454b9-db81-4715-a89d-1e18b4739ffa tempest-TestServerVolumeAttachmentScenario-946377902 None] Created reservations ['27948ad4-c6d4-40a9-900e-14b1de6260ac', '78382d2a-7b96-441d-8981-095093fd0b57', '8c44b52a-deb6-4542-addf-9bfd179ca56b', '50677341-1624-47b2-88b1-252c7dedd687'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:04:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8fd454b9-db81-4715-a89d-1e18b4739ffa tempest-TestServerVolumeAttachmentScenario-946377902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:04:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8fd454b9-db81-4715-a89d-1e18b4739ffa tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:04:29 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8fd454b9-db81-4715-a89d-1e18b4739ffa tempest-TestServerVolumeAttachmentScenario-946377902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:04:29 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8fd454b9-db81-4715-a89d-1e18b4739ffa tempest-TestServerVolumeAttachmentScenario-946377902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:04:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8fd454b9-db81-4715-a89d-1e18b4739ffa tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:04:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8fd454b9-db81-4715-a89d-1e18b4739ffa tempest-TestServerVolumeAttachmentScenario-946377902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:29 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:04:29 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:29 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-cb938f05-8de5-4fc3-9c4b-eac91019565b tempest-TestServerVolumeAttachmentScenario-946377902 None] Acquiring lock "cinder-5d0533c5-58a6-4976-9c37-cba23168c2c9-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:04:29 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-cb938f05-8de5-4fc3-9c4b-eac91019565b tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "cinder-5d0533c5-58a6-4976-9c37-cba23168c2c9-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:04:29 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-cb938f05-8de5-4fc3-9c4b-eac91019565b tempest-TestServerVolumeAttachmentScenario-946377902 None] Acquiring lock "cinder-quobyte-5d0533c5-58a6-4976-9c37-cba23168c2c9" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:04:29 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-cb938f05-8de5-4fc3-9c4b-eac91019565b tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "cinder-quobyte-5d0533c5-58a6-4976-9c37-cba23168c2c9" acquired by "delete_volume" :: waited 0.030s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:04:29 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f989ca-23b7-469b-8692-a146347ad999]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:04:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cb938f05-8de5-4fc3-9c4b-eac91019565b tempest-TestServerVolumeAttachmentScenario-946377902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5d0533c5-58a6-4976-9c37-cba23168c2c9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:30 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5d0533c5-58a6-4976-9c37-cba23168c2c9 Jun 03 12:04:30 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:30 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8fd454b9-db81-4715-a89d-1e18b4739ffa tempest-TestServerVolumeAttachmentScenario-946377902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.651s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:30 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-8fd454b9-db81-4715-a89d-1e18b4739ffa tempest-TestServerVolumeAttachmentScenario-946377902 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:04:30 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-8fd454b9-db81-4715-a89d-1e18b4739ffa tempest-TestServerVolumeAttachmentScenario-946377902 None] Deleted volume successfully. Jun 03 12:04:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8fd454b9-db81-4715-a89d-1e18b4739ffa tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "cinder-ce510bfb-cf75-4f73-a95f-e3715a896b01-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:04:30 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cb938f05-8de5-4fc3-9c4b-eac91019565b tempest-TestServerVolumeAttachmentScenario-946377902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5d0533c5-58a6-4976-9c37-cba23168c2c9" returned: 0 in 0.905s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cb938f05-8de5-4fc3-9c4b-eac91019565b tempest-TestServerVolumeAttachmentScenario-946377902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5d0533c5-58a6-4976-9c37-cba23168c2c9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:30 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5d0533c5-58a6-4976-9c37-cba23168c2c9 Jun 03 12:04:30 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:31 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cb938f05-8de5-4fc3-9c4b-eac91019565b tempest-TestServerVolumeAttachmentScenario-946377902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-5d0533c5-58a6-4976-9c37-cba23168c2c9" returned: 0 in 0.731s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:31 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-cb938f05-8de5-4fc3-9c4b-eac91019565b tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "cinder-quobyte-5d0533c5-58a6-4976-9c37-cba23168c2c9" released by "delete_volume" :: held 1.698s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:04:31 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-cb938f05-8de5-4fc3-9c4b-eac91019565b tempest-TestServerVolumeAttachmentScenario-946377902 None] Created reservations ['835b3ba7-1bb2-4570-bf3b-3f9139f39dda', 'e80d678d-10e3-45ea-b451-b564c4961ce5', '37d45a78-3cd7-4659-9fd8-6dc56d4c2319', 'af1a86b4-3fbe-414e-a113-c49628fe088b'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:04:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cb938f05-8de5-4fc3-9c4b-eac91019565b tempest-TestServerVolumeAttachmentScenario-946377902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:04:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cb938f05-8de5-4fc3-9c4b-eac91019565b tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:04:31 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-cb938f05-8de5-4fc3-9c4b-eac91019565b tempest-TestServerVolumeAttachmentScenario-946377902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:04:31 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-cb938f05-8de5-4fc3-9c4b-eac91019565b tempest-TestServerVolumeAttachmentScenario-946377902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:04:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cb938f05-8de5-4fc3-9c4b-eac91019565b tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:04:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cb938f05-8de5-4fc3-9c4b-eac91019565b tempest-TestServerVolumeAttachmentScenario-946377902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:31 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:04:31 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:32 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cb938f05-8de5-4fc3-9c4b-eac91019565b tempest-TestServerVolumeAttachmentScenario-946377902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.686s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:32 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-cb938f05-8de5-4fc3-9c4b-eac91019565b tempest-TestServerVolumeAttachmentScenario-946377902 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:04:32 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-cb938f05-8de5-4fc3-9c4b-eac91019565b tempest-TestServerVolumeAttachmentScenario-946377902 None] Deleted volume successfully. Jun 03 12:04:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-cb938f05-8de5-4fc3-9c4b-eac91019565b tempest-TestServerVolumeAttachmentScenario-946377902 None] Lock "cinder-5d0533c5-58a6-4976-9c37-cba23168c2c9-delete_volume" released by "delete_volume" :: held 2.694s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:04:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-9c493a6f-a4a0-46f0-816b-1c48410a904d req-94509e86-1886-4f65-ab6c-7a5964f3c062 tempest-TestStampPattern-576404759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:04:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 12:04:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:04:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:04:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:04:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:04:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:04:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:37 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:04:37 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:37 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.681s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:37 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:04:44 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=42,cinder:UPDATE=27,cinder:INSERT=13,cinder:DELETE=3 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:04:44 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=48,cinder:UPDATE=33,cinder:INSERT=12,cinder:DELETE=1 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:04:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c4c3adc4-ecb6-472a-b216-7073201b2058 tempest-VolumesActionsTest-43259975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.909s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:04:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c4c3adc4-ecb6-472a-b216-7073201b2058 tempest-VolumesActionsTest-43259975 None] Uploaded volume to glance image-id: 2435c15a-8f1e-4243-8656-a9b027d8ff6d. {{(pid=86724) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 03 12:04:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-dcfd7cc3-b019-4a2c-a565-9a7ecebcc5ba req-2d691017-2f1a-4866-8076-a4759cee9888 tempest-TestShelveInstance-1271863328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 21.130s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:04:46 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c4c3adc4-ecb6-472a-b216-7073201b2058 tempest-VolumesActionsTest-43259975 None] Copy volume to image completed successfully. Jun 03 12:04:46 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad5c596-64fa-4ad7-8651-3b35597122ef]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:04:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-dcfd7cc3-b019-4a2c-a565-9a7ecebcc5ba req-2d691017-2f1a-4866-8076-a4759cee9888 tempest-TestShelveInstance-1271863328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:46 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 Jun 03 12:04:46 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:47 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-dcfd7cc3-b019-4a2c-a565-9a7ecebcc5ba req-2d691017-2f1a-4866-8076-a4759cee9888 tempest-TestShelveInstance-1271863328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96" returned: 0 in 0.856s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-dcfd7cc3-b019-4a2c-a565-9a7ecebcc5ba req-2d691017-2f1a-4866-8076-a4759cee9888 tempest-TestShelveInstance-1271863328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:47 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 Jun 03 12:04:47 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:48 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-dcfd7cc3-b019-4a2c-a565-9a7ecebcc5ba req-2d691017-2f1a-4866-8076-a4759cee9888 tempest-TestShelveInstance-1271863328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96" returned: 1 in 0.721s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-dcfd7cc3-b019-4a2c-a565-9a7ecebcc5ba req-2d691017-2f1a-4866-8076-a4759cee9888 tempest-TestShelveInstance-1271863328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:04:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-dcfd7cc3-b019-4a2c-a565-9a7ecebcc5ba req-2d691017-2f1a-4866-8076-a4759cee9888 tempest-TestShelveInstance-1271863328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.625s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:04:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-9c493a6f-a4a0-46f0-816b-1c48410a904d req-94509e86-1886-4f65-ab6c-7a5964f3c062 tempest-TestStampPattern-576404759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.867s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:04:48 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5832c9-279a-4750-9f06-05c4d0844db4]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:04:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-9c493a6f-a4a0-46f0-816b-1c48410a904d req-94509e86-1886-4f65-ab6c-7a5964f3c062 tempest-TestStampPattern-576404759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-dcfd7cc3-b019-4a2c-a565-9a7ecebcc5ba req-2d691017-2f1a-4866-8076-a4759cee9888 tempest-TestShelveInstance-1271863328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-135f9f69-b862-408e-968f-21bc59fa6d96', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f58c4c67-c62c-428b-8a10-f90fe3b74f04', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 12:04:48 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-dcfd7cc3-b019-4a2c-a565-9a7ecebcc5ba req-2d691017-2f1a-4866-8076-a4759cee9888 tempest-TestShelveInstance-1271863328 None] attachment_update completed successfully. Jun 03 12:04:48 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 Jun 03 12:04:48 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:48 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-9c493a6f-a4a0-46f0-816b-1c48410a904d req-94509e86-1886-4f65-ab6c-7a5964f3c062 tempest-TestStampPattern-576404759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113" returned: 0 in 0.748s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-9c493a6f-a4a0-46f0-816b-1c48410a904d req-94509e86-1886-4f65-ab6c-7a5964f3c062 tempest-TestStampPattern-576404759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.768s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:04:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-9c493a6f-a4a0-46f0-816b-1c48410a904d req-94509e86-1886-4f65-ab6c-7a5964f3c062 tempest-TestStampPattern-576404759 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-8ea71870-0942-46ae-a0e0-7ad16892a113', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b870e222-23dd-4ed6-92c9-619bf082cdba', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 12:04:48 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-9c493a6f-a4a0-46f0-816b-1c48410a904d req-94509e86-1886-4f65-ab6c-7a5964f3c062 tempest-TestStampPattern-576404759 None] attachment_update completed successfully. Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Flow 'volume_create_manager' (372066b0-3421-45c6-93d4-118db2ef91b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3d4378-040e-410b-8391-da1976fe268c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3d4378-040e-410b-8391-da1976fe268c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-493570796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f7dc8a-72d6-48a8-9552-cf5f2316339b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8061b5a85a141f9b8e94c8615c25a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:04:49Z,use_quota=True,user_id='94c73c56683e419a808815e46eab8112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe9e45d-2227-480f-a8fe-caf7afbd51e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe9e45d-2227-480f-a8fe-caf7afbd51e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01fcc982-6c56-48e1-b7a0-649220b0d5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01fcc982-6c56-48e1-b7a0-649220b0d5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97f7dc8a-72d6-48a8-9552-cf5f2316339b', 'volume_name': 'volume-97f7dc8a-72d6-48a8-9552-cf5f2316339b', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a307ef-0cb9-41c8-844c-8d535ef1bbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a307ef-0cb9-41c8-844c-8d535ef1bbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaef4bca-ad24-4892-b335-fcbe5b944488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:49 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Volume 97f7dc8a-72d6-48a8-9552-cf5f2316339b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97f7dc8a-72d6-48a8-9552-cf5f2316339b', 'volume_size': 1} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-493570796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f7dc8a-72d6-48a8-9552-cf5f2316339b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8061b5a85a141f9b8e94c8615c25a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:04:49Z,use_quota=True,user_id='94c73c56683e419a808815e46eab8112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Creating volume 97f7dc8a-72d6-48a8-9552-cf5f2316339b {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:04:49 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97f7dc8a-72d6-48a8-9552-cf5f2316339b 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:49 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97f7dc8a-72d6-48a8-9552-cf5f2316339b 1073741824 Jun 03 12:04:49 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Flow 'volume_create_manager' (005cccc8-5b80-4c24-a79d-1937c05147e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d304e6ca-8c2c-4a80-b1a3-759022e89f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d304e6ca-8c2c-4a80-b1a3-759022e89f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1362101954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2b90172-0b52-4b1a-b3cd-248ed66b7ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8061b5a85a141f9b8e94c8615c25a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:04:50Z,use_quota=True,user_id='94c73c56683e419a808815e46eab8112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349af8eb-25e5-4087-96a4-074264c1b23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349af8eb-25e5-4087-96a4-074264c1b23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6d31da7-07d4-475b-86ef-7a13fb2f3ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6d31da7-07d4-475b-86ef-7a13fb2f3ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2b90172-0b52-4b1a-b3cd-248ed66b7ac7', 'volume_name': 'volume-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5cb064b-d575-4cab-b47a-3c41a353a836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5cb064b-d575-4cab-b47a-3c41a353a836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8869b654-f54b-4cdb-be81-727968c7c922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:49 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Volume a2b90172-0b52-4b1a-b3cd-248ed66b7ac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7', 'volume_size': 1} Jun 03 12:04:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Flow 'volume_create_manager' (e2233b2f-ea9f-444d-80f6-ed0cb89a6dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25db16b6-b183-414c-8247-2a04673bea83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25db16b6-b183-414c-8247-2a04673bea83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-985938846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=176eaa4f-3935-4b23-9f9a-f46a41a30c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8061b5a85a141f9b8e94c8615c25a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:04:50Z,use_quota=True,user_id='94c73c56683e419a808815e46eab8112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbec86ab-26f8-4e44-8b04-da5360d8430e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbec86ab-26f8-4e44-8b04-da5360d8430e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093f6f34-434f-49c1-8b83-c2a7b146a098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093f6f34-434f-49c1-8b83-c2a7b146a098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '176eaa4f-3935-4b23-9f9a-f46a41a30c65', 'volume_name': 'volume-176eaa4f-3935-4b23-9f9a-f46a41a30c65', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78c3686-2a34-48bf-abed-a33623afd38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78c3686-2a34-48bf-abed-a33623afd38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16f0331-0ba6-4a16-9aba-c27594937880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:50 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Volume 176eaa4f-3935-4b23-9f9a-f46a41a30c65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-176eaa4f-3935-4b23-9f9a-f46a41a30c65', 'volume_size': 1} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97f7dc8a-72d6-48a8-9552-cf5f2316339b 1073741824" returned: 0 in 1.369s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:50 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97f7dc8a-72d6-48a8-9552-cf5f2316339b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:50 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97f7dc8a-72d6-48a8-9552-cf5f2316339b Jun 03 12:04:50 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Flow 'volume_create_manager' (e645fdb7-937e-4cab-aaf7-76fa4beedd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6416fce-c4c2-4e09-8be4-c2b5aeb72258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6416fce-c4c2-4e09-8be4-c2b5aeb72258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1774649514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc41887-631b-4530-ba90-e1fef989ef13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8061b5a85a141f9b8e94c8615c25a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:04:51Z,use_quota=True,user_id='94c73c56683e419a808815e46eab8112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae28f43-5581-4f58-a7c6-a897c94ccc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae28f43-5581-4f58-a7c6-a897c94ccc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004514ec-f6c9-405a-8883-75ea4874dc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004514ec-f6c9-405a-8883-75ea4874dc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fc41887-631b-4530-ba90-e1fef989ef13', 'volume_name': 'volume-8fc41887-631b-4530-ba90-e1fef989ef13', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a1a250-29ba-4829-bbfb-75898d54c8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a1a250-29ba-4829-bbfb-75898d54c8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2439bc17-da6f-4a9b-9af6-fa0e2a702327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:50 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Volume 8fc41887-631b-4530-ba90-e1fef989ef13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fc41887-631b-4530-ba90-e1fef989ef13', 'volume_size': 1} Jun 03 12:04:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:04:51 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97f7dc8a-72d6-48a8-9552-cf5f2316339b" returned: 0 in 0.740s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] <== create_volume: return (2165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.167s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.615s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1362101954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2b90172-0b52-4b1a-b3cd-248ed66b7ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8061b5a85a141f9b8e94c8615c25a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:04:50Z,use_quota=True,user_id='94c73c56683e419a808815e46eab8112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Creating volume a2b90172-0b52-4b1a-b3cd-248ed66b7ac7 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:04:51 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaef4bca-ad24-4892-b335-fcbe5b944488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97f7dc8a-72d6-48a8-9552-cf5f2316339b', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:51 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7 1073741824 Jun 03 12:04:51 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6261a717-186f-4026-9f46-58f1dcb8d50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:51 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Volume volume-97f7dc8a-72d6-48a8-9552-cf5f2316339b (97f7dc8a-72d6-48a8-9552-cf5f2316339b): created successfully Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6261a717-186f-4026-9f46-58f1dcb8d50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Flow 'volume_create_manager' (372066b0-3421-45c6-93d4-118db2ef91b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:04:51 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-1c9b2834-c138-4045-8402-e709b7158ac2 tempest-CreateVolumesFromImageTest-99179355 None] Created volume successfully. Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Flow 'volume_create_manager' (806ca976-94f2-4882-a998-7983ea909f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446ae3ef-1fbd-49fe-9489-76886668482f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446ae3ef-1fbd-49fe-9489-76886668482f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-321663982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa3c977-0453-49a9-9be5-35c641031e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8061b5a85a141f9b8e94c8615c25a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:04:52Z,use_quota=True,user_id='94c73c56683e419a808815e46eab8112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91fd2049-94b9-4444-9688-df43a6df2a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91fd2049-94b9-4444-9688-df43a6df2a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6c5654-639e-48a0-9af8-66a5255958ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6c5654-639e-48a0-9af8-66a5255958ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baa3c977-0453-49a9-9be5-35c641031e1c', 'volume_name': 'volume-baa3c977-0453-49a9-9be5-35c641031e1c', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad766698-a882-4731-9b3d-e31c6d4bfbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad766698-a882-4731-9b3d-e31c6d4bfbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b170dcc-20ac-422a-8bf6-9d9d55d87e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:51 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Volume baa3c977-0453-49a9-9be5-35c641031e1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baa3c977-0453-49a9-9be5-35c641031e1c', 'volume_size': 1} Jun 03 12:04:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:04:52 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7 1073741824" returned: 0 in 0.916s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:52 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7 Jun 03 12:04:52 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:52 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7" returned: 0 in 0.631s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:04:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:04:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.688s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:04:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-985938846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=176eaa4f-3935-4b23-9f9a-f46a41a30c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8061b5a85a141f9b8e94c8615c25a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:04:50Z,use_quota=True,user_id='94c73c56683e419a808815e46eab8112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:04:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Creating volume 176eaa4f-3935-4b23-9f9a-f46a41a30c65 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:04:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:04:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:04:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:04:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:04:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:04:53 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:04:53 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:04:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-176eaa4f-3935-4b23-9f9a-f46a41a30c65 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:53 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-176eaa4f-3935-4b23-9f9a-f46a41a30c65 1073741824 Jun 03 12:04:53 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:53 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8869b654-f54b-4cdb-be81-727968c7c922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:53 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b980d41-5350-49dc-a9f2-1ebdffabb673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:53 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Volume volume-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7 (a2b90172-0b52-4b1a-b3cd-248ed66b7ac7): created successfully Jun 03 12:04:53 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b980d41-5350-49dc-a9f2-1ebdffabb673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:53 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Flow 'volume_create_manager' (005cccc8-5b80-4c24-a79d-1937c05147e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:04:53 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-f5b3ab19-f553-4de0-b0cd-fb1bd284b061 tempest-CreateVolumesFromImageTest-99179355 None] Created volume successfully. Jun 03 12:04:54 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-176eaa4f-3935-4b23-9f9a-f46a41a30c65 1073741824" returned: 0 in 1.520s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-176eaa4f-3935-4b23-9f9a-f46a41a30c65 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:54 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-176eaa4f-3935-4b23-9f9a-f46a41a30c65 Jun 03 12:04:54 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:55 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-176eaa4f-3935-4b23-9f9a-f46a41a30c65" returned: 0 in 0.716s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:55 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] <== create_volume: return (2279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:04:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.283s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:04:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 4.836s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:04:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16f0331-0ba6-4a16-9aba-c27594937880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-176eaa4f-3935-4b23-9f9a-f46a41a30c65', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b67826-bad5-42d6-9d52-ea6cc0439d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:04:55 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Volume volume-176eaa4f-3935-4b23-9f9a-f46a41a30c65 (176eaa4f-3935-4b23-9f9a-f46a41a30c65): created successfully Jun 03 12:04:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b67826-bad5-42d6-9d52-ea6cc0439d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:04:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Flow 'volume_create_manager' (e2233b2f-ea9f-444d-80f6-ed0cb89a6dae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:04:55 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8284209-3b07-4915-9d3e-1378ecf9b77f]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:04:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:55 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-4c6469b2-8789-424b-979a-30ff507ac496 tempest-CreateVolumesFromImageTest-99179355 None] Created volume successfully. Jun 03 12:04:55 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 Jun 03 12:04:55 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:56 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4" returned: 0 in 0.851s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:56 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34bd2f7-1165-4052-997e-882be208b590]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:04:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:56 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 Jun 03 12:04:56 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:57 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Jun 03 12:04:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4" returned: 0 in 0.922s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:04:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 /opt/stack/data/cinder/conversion/c5206fbb-6f03-47fc-bcac-b1b174c338e4.temp_image.2b424902-6b73-4c24-8ec9-5f2bf685a6808ufzxk5e.img {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:04:57 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 /opt/stack/data/cinder/conversion/c5206fbb-6f03-47fc-bcac-b1b174c338e4.temp_image.2b424902-6b73-4c24-8ec9-5f2bf685a6808ufzxk5e.img Jun 03 12:04:57 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:04:59 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-5b812a3e-60b2-4acd-a0e2-3b3f9aad9bcb req-9fe79683-2b3e-4e01-91ad-b73b57f15b0f tempest-TestStampPattern-576404759 None] Terminate volume connection completed successfully. Jun 03 12:04:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-5b812a3e-60b2-4acd-a0e2-3b3f9aad9bcb req-9fe79683-2b3e-4e01-91ad-b73b57f15b0f tempest-TestStampPattern-576404759 None] Deleting attachment b870e222-23dd-4ed6-92c9-619bf082cdba. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 12:05:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dadf233f-71bd-461a-a64f-0438b07274be tempest-TestStampPattern-576404759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:04 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 /opt/stack/data/cinder/conversion/c5206fbb-6f03-47fc-bcac-b1b174c338e4.temp_image.2b424902-6b73-4c24-8ec9-5f2bf685a6808ufzxk5e.img" returned: 0 in 7.554s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:04 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acea3f6-e9f7-4fcb-b9d3-06ab4c66d61f]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:04 devstack sudo[100924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 Jun 03 12:05:04 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:05 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4" returned: 0 in 0.922s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:05 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] Image conversion details: src /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4, size 1024.00 MB, duration 7.55 sec, destination /opt/stack/data/cinder/conversion/c5206fbb-6f03-47fc-bcac-b1b174c338e4.temp_image.2b424902-6b73-4c24-8ec9-5f2bf685a6808ufzxk5e.img {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 12:05:05 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] Converted 1024.00 MB image at 135.54 MB/s Jun 03 12:05:05 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] 2b424902-6b73-4c24-8ec9-5f2bf685a680 was raw, converting to qcow2 {{(pid=86724) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Jun 03 12:05:05 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b9872f-2967-4961-a36a-4e82a2219895]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c5206fbb-6f03-47fc-bcac-b1b174c338e4.temp_image.2b424902-6b73-4c24-8ec9-5f2bf685a6808ufzxk5e.img {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:05 devstack sudo[100929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c5206fbb-6f03-47fc-bcac-b1b174c338e4.temp_image.2b424902-6b73-4c24-8ec9-5f2bf685a6808ufzxk5e.img Jun 03 12:05:05 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:06 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c5206fbb-6f03-47fc-bcac-b1b174c338e4.temp_image.2b424902-6b73-4c24-8ec9-5f2bf685a6808ufzxk5e.img" returned: 0 in 0.698s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c5206fbb-6f03-47fc-bcac-b1b174c338e4.temp_image.2b424902-6b73-4c24-8ec9-5f2bf685a6808ufzxk5e.img {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:06 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c5206fbb-6f03-47fc-bcac-b1b174c338e4.temp_image.2b424902-6b73-4c24-8ec9-5f2bf685a6808ufzxk5e.img Jun 03 12:05:06 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:07 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c5206fbb-6f03-47fc-bcac-b1b174c338e4.temp_image.2b424902-6b73-4c24-8ec9-5f2bf685a6808ufzxk5e.img" returned: 1 in 0.683s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c5206fbb-6f03-47fc-bcac-b1b174c338e4.temp_image.2b424902-6b73-4c24-8ec9-5f2bf685a6808ufzxk5e.img' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:05:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c5206fbb-6f03-47fc-bcac-b1b174c338e4.temp_image.2b424902-6b73-4c24-8ec9-5f2bf685a6808ufzxk5e.img /opt/stack/data/cinder/conversion/vol_upload_csypo2l5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:07 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c5206fbb-6f03-47fc-bcac-b1b174c338e4.temp_image.2b424902-6b73-4c24-8ec9-5f2bf685a6808ufzxk5e.img /opt/stack/data/cinder/conversion/vol_upload_csypo2l5 Jun 03 12:05:07 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:07 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c5206fbb-6f03-47fc-bcac-b1b174c338e4.temp_image.2b424902-6b73-4c24-8ec9-5f2bf685a6808ufzxk5e.img /opt/stack/data/cinder/conversion/vol_upload_csypo2l5" returned: 0 in 0.612s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:07 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] Image conversion details: src /opt/stack/data/cinder/conversion/c5206fbb-6f03-47fc-bcac-b1b174c338e4.temp_image.2b424902-6b73-4c24-8ec9-5f2bf685a6808ufzxk5e.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_csypo2l5 {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 12:05:07 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 03 12:05:07 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a6f884-cf54-40e8-8913-77f8eee9589f]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_csypo2l5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:07 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_csypo2l5 Jun 03 12:05:07 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:08 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_csypo2l5" returned: 0 in 0.690s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.511s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] Uploaded volume to glance image-id: 2b424902-6b73-4c24-8ec9-5f2bf685a680. {{(pid=86724) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 03 12:05:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.967s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1774649514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc41887-631b-4530-ba90-e1fef989ef13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8061b5a85a141f9b8e94c8615c25a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:04:51Z,use_quota=True,user_id='94c73c56683e419a808815e46eab8112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:05:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Creating volume 8fc41887-631b-4530-ba90-e1fef989ef13 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:05:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:05:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:05:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:05:09 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:05:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fc41887-631b-4530-ba90-e1fef989ef13 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:09 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fc41887-631b-4530-ba90-e1fef989ef13 1073741824 Jun 03 12:05:09 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:09 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c612834a-95d8-45a5-9a78-66dcbe1398e1 tempest-VolumesActionsTest-43259975 None] Copy volume to image completed successfully. Jun 03 12:05:10 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fc41887-631b-4530-ba90-e1fef989ef13 1073741824" returned: 0 in 0.785s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fc41887-631b-4530-ba90-e1fef989ef13 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:10 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fc41887-631b-4530-ba90-e1fef989ef13 Jun 03 12:05:10 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:11 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e222b427-ef37-4945-ae7b-0541cdc10afe tempest-VolumesActionsTest-43259975 None] Acquiring lock "cinder-c5206fbb-6f03-47fc-bcac-b1b174c338e4-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fc41887-631b-4530-ba90-e1fef989ef13" returned: 0 in 0.668s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.553s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-321663982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa3c977-0453-49a9-9be5-35c641031e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8061b5a85a141f9b8e94c8615c25a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:04:52Z,use_quota=True,user_id='94c73c56683e419a808815e46eab8112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Creating volume baa3c977-0453-49a9-9be5-35c641031e1c {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:05:11 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-baa3c977-0453-49a9-9be5-35c641031e1c 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2439bc17-da6f-4a9b-9af6-fa0e2a702327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fc41887-631b-4530-ba90-e1fef989ef13', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc32983-5431-4953-b6d1-a8ff454d2bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:11 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-baa3c977-0453-49a9-9be5-35c641031e1c 1073741824 Jun 03 12:05:11 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e222b427-ef37-4945-ae7b-0541cdc10afe tempest-VolumesActionsTest-43259975 None] Lock "cinder-c5206fbb-6f03-47fc-bcac-b1b174c338e4-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:05:11 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Volume volume-8fc41887-631b-4530-ba90-e1fef989ef13 (8fc41887-631b-4530-ba90-e1fef989ef13): created successfully Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc32983-5431-4953-b6d1-a8ff454d2bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Flow 'volume_create_manager' (e645fdb7-937e-4cab-aaf7-76fa4beedd19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:05:11 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-fd79368b-ac79-4ed7-8116-575a6f41e701 tempest-CreateVolumesFromImageTest-99179355 None] Created volume successfully. Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e222b427-ef37-4945-ae7b-0541cdc10afe tempest-VolumesActionsTest-43259975 None] Acquiring lock "cinder-quobyte-c5206fbb-6f03-47fc-bcac-b1b174c338e4" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e222b427-ef37-4945-ae7b-0541cdc10afe tempest-VolumesActionsTest-43259975 None] Lock "cinder-quobyte-c5206fbb-6f03-47fc-bcac-b1b174c338e4" acquired by "delete_volume" :: waited 0.019s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f6cdcb-9ecb-41ff-b931-7762546b55a0]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e222b427-ef37-4945-ae7b-0541cdc10afe tempest-VolumesActionsTest-43259975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:11 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 Jun 03 12:05:11 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:12 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e222b427-ef37-4945-ae7b-0541cdc10afe tempest-VolumesActionsTest-43259975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4" returned: 0 in 0.775s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e222b427-ef37-4945-ae7b-0541cdc10afe tempest-VolumesActionsTest-43259975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:12 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4 Jun 03 12:05:12 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:12 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-baa3c977-0453-49a9-9be5-35c641031e1c 1073741824" returned: 0 in 1.181s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-baa3c977-0453-49a9-9be5-35c641031e1c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:12 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-baa3c977-0453-49a9-9be5-35c641031e1c Jun 03 12:05:12 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:12 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e222b427-ef37-4945-ae7b-0541cdc10afe tempest-VolumesActionsTest-43259975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c5206fbb-6f03-47fc-bcac-b1b174c338e4" returned: 0 in 0.696s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:12 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e222b427-ef37-4945-ae7b-0541cdc10afe tempest-VolumesActionsTest-43259975 None] Lock "cinder-quobyte-c5206fbb-6f03-47fc-bcac-b1b174c338e4" released by "delete_volume" :: held 1.519s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-e222b427-ef37-4945-ae7b-0541cdc10afe tempest-VolumesActionsTest-43259975 None] Created reservations ['180e8715-cd8e-43dc-ac0d-0749db671807', 'af05ee52-aec2-4ba2-b861-68a2e60c4dab', 'a52a7567-1577-4e3d-9089-8421e2610032', '7eb324fd-79e1-4a22-b1c3-f72103ccd07b'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e222b427-ef37-4945-ae7b-0541cdc10afe tempest-VolumesActionsTest-43259975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e222b427-ef37-4945-ae7b-0541cdc10afe tempest-VolumesActionsTest-43259975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e222b427-ef37-4945-ae7b-0541cdc10afe tempest-VolumesActionsTest-43259975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e222b427-ef37-4945-ae7b-0541cdc10afe tempest-VolumesActionsTest-43259975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e222b427-ef37-4945-ae7b-0541cdc10afe tempest-VolumesActionsTest-43259975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e222b427-ef37-4945-ae7b-0541cdc10afe tempest-VolumesActionsTest-43259975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:13 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:05:13 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:13 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-baa3c977-0453-49a9-9be5-35c641031e1c" returned: 0 in 0.700s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.943s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dadf233f-71bd-461a-a64f-0438b07274be tempest-TestStampPattern-576404759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.565s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-dadf233f-71bd-461a-a64f-0438b07274be tempest-TestStampPattern-576404759 None] Creating offline snapshot 8feef30d-75e9-41fd-91fb-3c9e16d918d9 of volume 8ea71870-0942-46ae-a0e0-7ad16892a113 {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b170dcc-20ac-422a-8bf6-9d9d55d87e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baa3c977-0453-49a9-9be5-35c641031e1c', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fcc8d9a-b5f7-4dc7-82b2-7b5f2da65b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0f08da-86da-4878-9330-3b6f86bf096d]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dadf233f-71bd-461a-a64f-0438b07274be tempest-TestStampPattern-576404759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:13 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Volume volume-baa3c977-0453-49a9-9be5-35c641031e1c (baa3c977-0453-49a9-9be5-35c641031e1c): created successfully Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fcc8d9a-b5f7-4dc7-82b2-7b5f2da65b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Flow 'volume_create_manager' (806ca976-94f2-4882-a998-7983ea909f27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:05:13 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-e1715a03-6178-4fe5-91ca-815c6a1df0b8 tempest-CreateVolumesFromImageTest-99179355 None] Created volume successfully. Jun 03 12:05:13 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 Jun 03 12:05:13 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-11ddfc83-1d2e-4290-b75a-0b8101db91b5 tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "cinder-baa3c977-0453-49a9-9be5-35c641031e1c-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-11ddfc83-1d2e-4290-b75a-0b8101db91b5 tempest-CreateVolumesFromImageTest-99179355 None] Lock "cinder-baa3c977-0453-49a9-9be5-35c641031e1c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-11ddfc83-1d2e-4290-b75a-0b8101db91b5 tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "cinder-quobyte-baa3c977-0453-49a9-9be5-35c641031e1c" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-11ddfc83-1d2e-4290-b75a-0b8101db91b5 tempest-CreateVolumesFromImageTest-99179355 None] Lock "cinder-quobyte-baa3c977-0453-49a9-9be5-35c641031e1c" acquired by "delete_volume" :: waited 0.024s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6248b698-8011-4a4a-8f30-3248334e3630]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-11ddfc83-1d2e-4290-b75a-0b8101db91b5 tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-baa3c977-0453-49a9-9be5-35c641031e1c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:13 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-baa3c977-0453-49a9-9be5-35c641031e1c Jun 03 12:05:13 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:13 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e222b427-ef37-4945-ae7b-0541cdc10afe tempest-VolumesActionsTest-43259975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.676s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-e222b427-ef37-4945-ae7b-0541cdc10afe tempest-VolumesActionsTest-43259975 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:05:13 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-e222b427-ef37-4945-ae7b-0541cdc10afe tempest-VolumesActionsTest-43259975 None] Deleted volume successfully. Jun 03 12:05:13 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e222b427-ef37-4945-ae7b-0541cdc10afe tempest-VolumesActionsTest-43259975 None] Lock "cinder-c5206fbb-6f03-47fc-bcac-b1b174c338e4-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:05:14 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dadf233f-71bd-461a-a64f-0438b07274be tempest-TestStampPattern-576404759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113" returned: 0 in 0.898s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dadf233f-71bd-461a-a64f-0438b07274be tempest-TestStampPattern-576404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:14 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9 1G Jun 03 12:05:14 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:14 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-11ddfc83-1d2e-4290-b75a-0b8101db91b5 tempest-CreateVolumesFromImageTest-99179355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-baa3c977-0453-49a9-9be5-35c641031e1c" returned: 0 in 0.881s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-11ddfc83-1d2e-4290-b75a-0b8101db91b5 tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-baa3c977-0453-49a9-9be5-35c641031e1c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:14 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-baa3c977-0453-49a9-9be5-35c641031e1c Jun 03 12:05:14 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:15 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dadf233f-71bd-461a-a64f-0438b07274be tempest-TestStampPattern-576404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9 1G" returned: 0 in 0.871s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dadf233f-71bd-461a-a64f-0438b07274be tempest-TestStampPattern-576404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ea71870-0942-46ae-a0e0-7ad16892a113 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:15 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ea71870-0942-46ae-a0e0-7ad16892a113 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9 Jun 03 12:05:15 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:15 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-11ddfc83-1d2e-4290-b75a-0b8101db91b5 tempest-CreateVolumesFromImageTest-99179355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-baa3c977-0453-49a9-9be5-35c641031e1c" returned: 0 in 0.647s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:15 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-11ddfc83-1d2e-4290-b75a-0b8101db91b5 tempest-CreateVolumesFromImageTest-99179355 None] Lock "cinder-quobyte-baa3c977-0453-49a9-9be5-35c641031e1c" released by "delete_volume" :: held 1.606s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:05:15 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-11ddfc83-1d2e-4290-b75a-0b8101db91b5 tempest-CreateVolumesFromImageTest-99179355 None] Created reservations ['d27dfc98-1800-46af-b1a0-301145b359e9', '455f624e-89ee-4499-9aa8-00cd820addb3', 'e4200400-bb5b-450f-bb81-fd035ec72e95', '6b6763eb-c381-4a34-8c51-8abff347d0c6'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:05:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-11ddfc83-1d2e-4290-b75a-0b8101db91b5 tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-11ddfc83-1d2e-4290-b75a-0b8101db91b5 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-11ddfc83-1d2e-4290-b75a-0b8101db91b5 tempest-CreateVolumesFromImageTest-99179355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:05:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-11ddfc83-1d2e-4290-b75a-0b8101db91b5 tempest-CreateVolumesFromImageTest-99179355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:05:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-11ddfc83-1d2e-4290-b75a-0b8101db91b5 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-11ddfc83-1d2e-4290-b75a-0b8101db91b5 tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:15 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:05:15 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:15 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-58890b1f-f76a-4ebc-98d7-c378a2b7cf0d tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "cinder-8fc41887-631b-4530-ba90-e1fef989ef13-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:05:15 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-58890b1f-f76a-4ebc-98d7-c378a2b7cf0d tempest-CreateVolumesFromImageTest-99179355 None] Lock "cinder-8fc41887-631b-4530-ba90-e1fef989ef13-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:05:15 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dadf233f-71bd-461a-a64f-0438b07274be tempest-TestStampPattern-576404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ea71870-0942-46ae-a0e0-7ad16892a113 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9" returned: 0 in 0.823s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:15 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-dadf233f-71bd-461a-a64f-0438b07274be tempest-TestStampPattern-576404759 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9 is being set with open permissions: ugo+rw Jun 03 12:05:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dadf233f-71bd-461a-a64f-0438b07274be tempest-TestStampPattern-576404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:15 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-58890b1f-f76a-4ebc-98d7-c378a2b7cf0d tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "cinder-quobyte-8fc41887-631b-4530-ba90-e1fef989ef13" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:05:15 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9 Jun 03 12:05:15 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:15 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-58890b1f-f76a-4ebc-98d7-c378a2b7cf0d tempest-CreateVolumesFromImageTest-99179355 None] Lock "cinder-quobyte-8fc41887-631b-4530-ba90-e1fef989ef13" acquired by "delete_volume" :: waited 0.019s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:05:15 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8ef328-f21a-43b8-a439-6b8a3f0aa192]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-58890b1f-f76a-4ebc-98d7-c378a2b7cf0d tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fc41887-631b-4530-ba90-e1fef989ef13 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:16 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fc41887-631b-4530-ba90-e1fef989ef13 Jun 03 12:05:16 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:16 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-11ddfc83-1d2e-4290-b75a-0b8101db91b5 tempest-CreateVolumesFromImageTest-99179355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.764s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:16 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-11ddfc83-1d2e-4290-b75a-0b8101db91b5 tempest-CreateVolumesFromImageTest-99179355 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:05:16 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-11ddfc83-1d2e-4290-b75a-0b8101db91b5 tempest-CreateVolumesFromImageTest-99179355 None] Deleted volume successfully. Jun 03 12:05:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-11ddfc83-1d2e-4290-b75a-0b8101db91b5 tempest-CreateVolumesFromImageTest-99179355 None] Lock "cinder-baa3c977-0453-49a9-9be5-35c641031e1c-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:05:16 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dadf233f-71bd-461a-a64f-0438b07274be tempest-TestStampPattern-576404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9" returned: 0 in 0.723s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dadf233f-71bd-461a-a64f-0438b07274be tempest-TestStampPattern-576404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:16 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.info Jun 03 12:05:16 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:16 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-58890b1f-f76a-4ebc-98d7-c378a2b7cf0d tempest-CreateVolumesFromImageTest-99179355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fc41887-631b-4530-ba90-e1fef989ef13" returned: 0 in 0.824s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-58890b1f-f76a-4ebc-98d7-c378a2b7cf0d tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fc41887-631b-4530-ba90-e1fef989ef13 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:16 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fc41887-631b-4530-ba90-e1fef989ef13 Jun 03 12:05:16 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:17 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dadf233f-71bd-461a-a64f-0438b07274be tempest-TestStampPattern-576404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.info" returned: 0 in 0.717s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:17 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-dadf233f-71bd-461a-a64f-0438b07274be tempest-TestStampPattern-576404759 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.info is being set with open permissions: ugo+rw Jun 03 12:05:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dadf233f-71bd-461a-a64f-0438b07274be tempest-TestStampPattern-576404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:17 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.info Jun 03 12:05:17 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:17 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-58890b1f-f76a-4ebc-98d7-c378a2b7cf0d tempest-CreateVolumesFromImageTest-99179355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8fc41887-631b-4530-ba90-e1fef989ef13" returned: 0 in 0.733s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:17 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-58890b1f-f76a-4ebc-98d7-c378a2b7cf0d tempest-CreateVolumesFromImageTest-99179355 None] Lock "cinder-quobyte-8fc41887-631b-4530-ba90-e1fef989ef13" released by "delete_volume" :: held 1.621s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:05:17 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-58890b1f-f76a-4ebc-98d7-c378a2b7cf0d tempest-CreateVolumesFromImageTest-99179355 None] Created reservations ['2c5eff48-146d-4563-9174-b465fa0d4b5f', 'd0b92c9a-12a0-48dc-8097-fd4d920d03aa', '3925a055-9054-46af-8cc6-7a2bf216b054', 'f63710c4-ad20-429d-b3ad-8628e3823ae7'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:05:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-58890b1f-f76a-4ebc-98d7-c378a2b7cf0d tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-58890b1f-f76a-4ebc-98d7-c378a2b7cf0d tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-58890b1f-f76a-4ebc-98d7-c378a2b7cf0d tempest-CreateVolumesFromImageTest-99179355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:05:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-58890b1f-f76a-4ebc-98d7-c378a2b7cf0d tempest-CreateVolumesFromImageTest-99179355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:05:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-58890b1f-f76a-4ebc-98d7-c378a2b7cf0d tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-58890b1f-f76a-4ebc-98d7-c378a2b7cf0d tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:17 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:05:17 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8605dc2c-9a8c-451e-834f-b135667e4f38 tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "cinder-176eaa4f-3935-4b23-9f9a-f46a41a30c65-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:05:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8605dc2c-9a8c-451e-834f-b135667e4f38 tempest-CreateVolumesFromImageTest-99179355 None] Lock "cinder-176eaa4f-3935-4b23-9f9a-f46a41a30c65-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:05:18 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8605dc2c-9a8c-451e-834f-b135667e4f38 tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "cinder-quobyte-176eaa4f-3935-4b23-9f9a-f46a41a30c65" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:05:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dadf233f-71bd-461a-a64f-0438b07274be tempest-TestStampPattern-576404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.info" returned: 0 in 0.798s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dadf233f-71bd-461a-a64f-0438b07274be tempest-TestStampPattern-576404759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.963s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8605dc2c-9a8c-451e-834f-b135667e4f38 tempest-CreateVolumesFromImageTest-99179355 None] Lock "cinder-quobyte-176eaa4f-3935-4b23-9f9a-f46a41a30c65" acquired by "delete_volume" :: waited 0.062s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:05:18 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7476b504-860b-4d0e-bc3a-9f913755051b]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8605dc2c-9a8c-451e-834f-b135667e4f38 tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-176eaa4f-3935-4b23-9f9a-f46a41a30c65 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:18 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-dadf233f-71bd-461a-a64f-0438b07274be tempest-TestStampPattern-576404759 None] Create snapshot completed successfully Jun 03 12:05:18 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-58890b1f-f76a-4ebc-98d7-c378a2b7cf0d tempest-CreateVolumesFromImageTest-99179355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.657s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:18 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-58890b1f-f76a-4ebc-98d7-c378a2b7cf0d tempest-CreateVolumesFromImageTest-99179355 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:05:18 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-58890b1f-f76a-4ebc-98d7-c378a2b7cf0d tempest-CreateVolumesFromImageTest-99179355 None] Deleted volume successfully. Jun 03 12:05:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-58890b1f-f76a-4ebc-98d7-c378a2b7cf0d tempest-CreateVolumesFromImageTest-99179355 None] Lock "cinder-8fc41887-631b-4530-ba90-e1fef989ef13-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:05:18 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-176eaa4f-3935-4b23-9f9a-f46a41a30c65 Jun 03 12:05:18 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:19 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8605dc2c-9a8c-451e-834f-b135667e4f38 tempest-CreateVolumesFromImageTest-99179355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-176eaa4f-3935-4b23-9f9a-f46a41a30c65" returned: 0 in 0.887s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8605dc2c-9a8c-451e-834f-b135667e4f38 tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-176eaa4f-3935-4b23-9f9a-f46a41a30c65 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:19 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-176eaa4f-3935-4b23-9f9a-f46a41a30c65 Jun 03 12:05:19 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:19 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8605dc2c-9a8c-451e-834f-b135667e4f38 tempest-CreateVolumesFromImageTest-99179355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-176eaa4f-3935-4b23-9f9a-f46a41a30c65" returned: 0 in 0.684s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:19 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8605dc2c-9a8c-451e-834f-b135667e4f38 tempest-CreateVolumesFromImageTest-99179355 None] Lock "cinder-quobyte-176eaa4f-3935-4b23-9f9a-f46a41a30c65" released by "delete_volume" :: held 1.631s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:05:19 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-8605dc2c-9a8c-451e-834f-b135667e4f38 tempest-CreateVolumesFromImageTest-99179355 None] Created reservations ['1defc06f-87f9-4745-af76-8cf01b907e75', '5bcde5b0-5321-4006-8fc4-db8cb51d4265', 'da26d900-5bfc-4146-ba43-5125b111e750', 'c44a7920-85de-467e-b173-8de465870cee'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:05:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8605dc2c-9a8c-451e-834f-b135667e4f38 tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8605dc2c-9a8c-451e-834f-b135667e4f38 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8605dc2c-9a8c-451e-834f-b135667e4f38 tempest-CreateVolumesFromImageTest-99179355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:05:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8605dc2c-9a8c-451e-834f-b135667e4f38 tempest-CreateVolumesFromImageTest-99179355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:05:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8605dc2c-9a8c-451e-834f-b135667e4f38 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8605dc2c-9a8c-451e-834f-b135667e4f38 tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:20 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:05:20 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-9c1391d1-4db1-4449-a687-4d33c9c64be2 tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "cinder-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:05:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-9c1391d1-4db1-4449-a687-4d33c9c64be2 tempest-CreateVolumesFromImageTest-99179355 None] Lock "cinder-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:05:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-9c1391d1-4db1-4449-a687-4d33c9c64be2 tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "cinder-quobyte-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:05:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-9c1391d1-4db1-4449-a687-4d33c9c64be2 tempest-CreateVolumesFromImageTest-99179355 None] Lock "cinder-quobyte-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7" acquired by "delete_volume" :: waited 0.023s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:05:20 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[620ded6c-8fe6-47d4-b98b-0be53de3d853]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-9c1391d1-4db1-4449-a687-4d33c9c64be2 tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:20 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7 Jun 03 12:05:20 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:20 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8605dc2c-9a8c-451e-834f-b135667e4f38 tempest-CreateVolumesFromImageTest-99179355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.867s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:20 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-8605dc2c-9a8c-451e-834f-b135667e4f38 tempest-CreateVolumesFromImageTest-99179355 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:05:20 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-8605dc2c-9a8c-451e-834f-b135667e4f38 tempest-CreateVolumesFromImageTest-99179355 None] Deleted volume successfully. Jun 03 12:05:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8605dc2c-9a8c-451e-834f-b135667e4f38 tempest-CreateVolumesFromImageTest-99179355 None] Lock "cinder-176eaa4f-3935-4b23-9f9a-f46a41a30c65-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Flow 'volume_create_manager' (1328ff95-0e8b-4e85-b63e-7704d9f8fba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44db1a63-f9a3-45a8-b5a0-7fd494248fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44db1a63-f9a3-45a8-b5a0-7fd494248fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-489178065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b402ca62-98ea-4d55-8b19-8935f6ce6252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96954d329d54446c8954eedc2289ad60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:05:21Z,use_quota=True,user_id='bff184e47d9e4ee78f079c0bb636a286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccbe9876-498c-4969-ab5e-ffaa7907da69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccbe9876-498c-4969-ab5e-ffaa7907da69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a391b19c-056a-46d5-9d56-e888895e76f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a391b19c-056a-46d5-9d56-e888895e76f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b402ca62-98ea-4d55-8b19-8935f6ce6252', 'volume_name': 'volume-b402ca62-98ea-4d55-8b19-8935f6ce6252', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192c3bf2-996c-4d93-b2f7-2040dda950fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192c3bf2-996c-4d93-b2f7-2040dda950fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a83d99d-4efe-43ad-bd8d-d34bc1c8fe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:21 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Volume b402ca62-98ea-4d55-8b19-8935f6ce6252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b402ca62-98ea-4d55-8b19-8935f6ce6252', 'volume_size': 1} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-489178065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b402ca62-98ea-4d55-8b19-8935f6ce6252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96954d329d54446c8954eedc2289ad60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:05:21Z,use_quota=True,user_id='bff184e47d9e4ee78f079c0bb636a286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Creating volume b402ca62-98ea-4d55-8b19-8935f6ce6252 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:05:21 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:21 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 1073741824 Jun 03 12:05:21 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:21 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-9c1391d1-4db1-4449-a687-4d33c9c64be2 tempest-CreateVolumesFromImageTest-99179355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7" returned: 0 in 0.972s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-9c1391d1-4db1-4449-a687-4d33c9c64be2 tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:21 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7 Jun 03 12:05:21 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:22 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 1073741824" returned: 0 in 0.819s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:22 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-9c1391d1-4db1-4449-a687-4d33c9c64be2 tempest-CreateVolumesFromImageTest-99179355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7" returned: 0 in 0.732s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-9c1391d1-4db1-4449-a687-4d33c9c64be2 tempest-CreateVolumesFromImageTest-99179355 None] Lock "cinder-quobyte-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7" released by "delete_volume" :: held 1.785s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:05:22 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 Jun 03 12:05:22 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:22 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-9c1391d1-4db1-4449-a687-4d33c9c64be2 tempest-CreateVolumesFromImageTest-99179355 None] Created reservations ['7b564195-6b12-4a27-b2fa-a408d7f005ee', '540b8d76-dc37-4888-b193-0e84179cf0d2', 'e587a76b-5c95-483c-b118-96316b4cc6fc', 'c0f48344-ffee-4083-96d5-5489ca78e902'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:05:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-9c1391d1-4db1-4449-a687-4d33c9c64be2 tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-9c1391d1-4db1-4449-a687-4d33c9c64be2 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-9c1391d1-4db1-4449-a687-4d33c9c64be2 tempest-CreateVolumesFromImageTest-99179355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:05:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-9c1391d1-4db1-4449-a687-4d33c9c64be2 tempest-CreateVolumesFromImageTest-99179355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:05:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-9c1391d1-4db1-4449-a687-4d33c9c64be2 tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-9c1391d1-4db1-4449-a687-4d33c9c64be2 tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:22 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:05:22 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-59199163-5e41-442d-b529-41680709f3cc tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "cinder-97f7dc8a-72d6-48a8-9552-cf5f2316339b-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:05:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-59199163-5e41-442d-b529-41680709f3cc tempest-CreateVolumesFromImageTest-99179355 None] Lock "cinder-97f7dc8a-72d6-48a8-9552-cf5f2316339b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:05:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-59199163-5e41-442d-b529-41680709f3cc tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "cinder-quobyte-97f7dc8a-72d6-48a8-9552-cf5f2316339b" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:05:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-59199163-5e41-442d-b529-41680709f3cc tempest-CreateVolumesFromImageTest-99179355 None] Lock "cinder-quobyte-97f7dc8a-72d6-48a8-9552-cf5f2316339b" acquired by "delete_volume" :: waited 0.029s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:05:22 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cc920d-0982-4279-add9-8ec7e959a7dd]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-59199163-5e41-442d-b529-41680709f3cc tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97f7dc8a-72d6-48a8-9552-cf5f2316339b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:22 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97f7dc8a-72d6-48a8-9552-cf5f2316339b Jun 03 12:05:22 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:22 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252" returned: 0 in 0.690s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:23 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:05:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:23 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a83d99d-4efe-43ad-bd8d-d34bc1c8fe8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b402ca62-98ea-4d55-8b19-8935f6ce6252', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:23 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1b8955-669d-475b-8ad3-0c6e667a9074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:23 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Volume volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 (b402ca62-98ea-4d55-8b19-8935f6ce6252): created successfully Jun 03 12:05:23 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1b8955-669d-475b-8ad3-0c6e667a9074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:23 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Flow 'volume_create_manager' (1328ff95-0e8b-4e85-b63e-7704d9f8fba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:05:23 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-3275c34e-3b71-453e-ba43-599c29711e2e tempest-VolumesCloneTest-414782612 None] Created volume successfully. Jun 03 12:05:23 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-9c1391d1-4db1-4449-a687-4d33c9c64be2 tempest-CreateVolumesFromImageTest-99179355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.809s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:23 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-9c1391d1-4db1-4449-a687-4d33c9c64be2 tempest-CreateVolumesFromImageTest-99179355 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:05:23 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-9c1391d1-4db1-4449-a687-4d33c9c64be2 tempest-CreateVolumesFromImageTest-99179355 None] Deleted volume successfully. Jun 03 12:05:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-9c1391d1-4db1-4449-a687-4d33c9c64be2 tempest-CreateVolumesFromImageTest-99179355 None] Lock "cinder-a2b90172-0b52-4b1a-b3cd-248ed66b7ac7-delete_volume" released by "delete_volume" :: held 2.867s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:05:23 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-59199163-5e41-442d-b529-41680709f3cc tempest-CreateVolumesFromImageTest-99179355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97f7dc8a-72d6-48a8-9552-cf5f2316339b" returned: 0 in 0.869s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-59199163-5e41-442d-b529-41680709f3cc tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97f7dc8a-72d6-48a8-9552-cf5f2316339b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:23 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97f7dc8a-72d6-48a8-9552-cf5f2316339b Jun 03 12:05:23 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Flow 'volume_create_manager' (abcbf3b0-9429-4632-9a69-0ee4829e8a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85409fd2-8eac-45f7-90ff-5ed73ef16b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85409fd2-8eac-45f7-90ff-5ed73ef16b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1808233654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96954d329d54446c8954eedc2289ad60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:05:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b402ca62-98ea-4d55-8b19-8935f6ce6252,status='creating',terminated_at=None,updated_at=2026-06-03T10:05:24Z,use_quota=True,user_id='bff184e47d9e4ee78f079c0bb636a286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a8f7f9-1302-4ee4-98ee-61a3295bad94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a8f7f9-1302-4ee4-98ee-61a3295bad94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a6beb6d-44a9-46cb-a92e-a07eb87435e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a6beb6d-44a9-46cb-a92e-a07eb87435e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64', 'volume_name': 'volume-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64', 'volume_size': 2, 'source_volid': 'b402ca62-98ea-4d55-8b19-8935f6ce6252', 'source_volstatus': 'available'}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8d330a-5840-4b5f-8b1a-732fed32f3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8d330a-5840-4b5f-8b1a-732fed32f3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0dc7b3e-811b-47e5-bb81-34ec19e2130f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:24 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Volume c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64', 'volume_size': 2, 'source_volid': 'b402ca62-98ea-4d55-8b19-8935f6ce6252', 'source_volstatus': 'available'} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:24 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Cloning volume b402ca62-98ea-4d55-8b19-8935f6ce6252 to volume c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64 Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Creating offline snapshot 7cdc5d91-f410-4472-a9a7-992a5ddcbcca of volume b402ca62-98ea-4d55-8b19-8935f6ce6252 {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e12331-46fe-4526-a10c-7929961607b5]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:24 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 Jun 03 12:05:24 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:24 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-59199163-5e41-442d-b529-41680709f3cc tempest-CreateVolumesFromImageTest-99179355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-97f7dc8a-72d6-48a8-9552-cf5f2316339b" returned: 0 in 0.790s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-59199163-5e41-442d-b529-41680709f3cc tempest-CreateVolumesFromImageTest-99179355 None] Lock "cinder-quobyte-97f7dc8a-72d6-48a8-9552-cf5f2316339b" released by "delete_volume" :: held 1.735s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-59199163-5e41-442d-b529-41680709f3cc tempest-CreateVolumesFromImageTest-99179355 None] Created reservations ['0d0c8402-aa88-49d4-98e8-91df6549f0bf', '9004f7d6-fd27-4fef-8d44-50f80ee44cc4', '0abe9481-4d66-4fc9-a67a-f369d352955e', '3fe96a37-8ffa-4947-8a0d-6897f9bd6762'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-59199163-5e41-442d-b529-41680709f3cc tempest-CreateVolumesFromImageTest-99179355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-59199163-5e41-442d-b529-41680709f3cc tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-59199163-5e41-442d-b529-41680709f3cc tempest-CreateVolumesFromImageTest-99179355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-59199163-5e41-442d-b529-41680709f3cc tempest-CreateVolumesFromImageTest-99179355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-59199163-5e41-442d-b529-41680709f3cc tempest-CreateVolumesFromImageTest-99179355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-59199163-5e41-442d-b529-41680709f3cc tempest-CreateVolumesFromImageTest-99179355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:24 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:05:24 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:25 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252" returned: 0 in 0.964s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:25 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca 1G Jun 03 12:05:25 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:25 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-59199163-5e41-442d-b529-41680709f3cc tempest-CreateVolumesFromImageTest-99179355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.842s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:25 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-59199163-5e41-442d-b529-41680709f3cc tempest-CreateVolumesFromImageTest-99179355 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:05:25 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-59199163-5e41-442d-b529-41680709f3cc tempest-CreateVolumesFromImageTest-99179355 None] Deleted volume successfully. Jun 03 12:05:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-59199163-5e41-442d-b529-41680709f3cc tempest-CreateVolumesFromImageTest-99179355 None] Lock "cinder-97f7dc8a-72d6-48a8-9552-cf5f2316339b-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:05:26 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca 1G" returned: 0 in 0.869s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:26 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca Jun 03 12:05:26 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:27 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca" returned: 0 in 0.960s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:27 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca is being set with open permissions: ugo+rw Jun 03 12:05:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:27 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca Jun 03 12:05:27 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:28 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca" returned: 0 in 0.843s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:28 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.info Jun 03 12:05:28 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.info" returned: 0 in 0.922s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:29 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.info is being set with open permissions: ugo+rw Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:29 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:29 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.info Jun 03 12:05:29 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Flow 'volume_create_manager' (aed0a68d-6886-4c11-b562-ba144316ac43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88921eb-0a77-4f31-83bd-e02f71f1b3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88921eb-0a77-4f31-83bd-e02f71f1b3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-563621653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6fc47f-098f-4029-aa81-4d471a6c0228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3c7f78fb6e47c19b0cfb3f017f13d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:05:29Z,use_quota=True,user_id='c6e22748fe934eb7a842d689e157e84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8afe93-c808-4db7-bad5-d20012665734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8afe93-c808-4db7-bad5-d20012665734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55e74df-ad8b-4625-8379-58a1d9b53375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55e74df-ad8b-4625-8379-58a1d9b53375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de6fc47f-098f-4029-aa81-4d471a6c0228', 'volume_name': 'volume-de6fc47f-098f-4029-aa81-4d471a6c0228', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f725abb-778c-4a9a-b522-1018d717e42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f725abb-778c-4a9a-b522-1018d717e42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397f4a2e-b721-46ac-9040-c7ddcb903cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:29 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Volume de6fc47f-098f-4029-aa81-4d471a6c0228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de6fc47f-098f-4029-aa81-4d471a6c0228', 'volume_size': 1} Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:29 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.info" returned: 0 in 0.868s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Acquiring lock "cinder-quobyte-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64" by "_copy_volume_from_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Lock "cinder-quobyte-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] snapshot: 7cdc5d91-f410-4472-a9a7-992a5ddcbcca, volume: c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64, {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c01000d-04ba-4eae-8964-501815cc35f8]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:30 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:05:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Flow 'volume_create_manager' (1606a772-5bec-44cc-a60d-95c581bedb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:05:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f496d3-0007-4737-b92c-d0b45e2f94c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f496d3-0007-4737-b92c-d0b45e2f94c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1030251065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91aa4734-d9fa-4481-9f6a-7288e0632c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79519871caf4d2ba9fde87a46746b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8feef30d-75e9-41fd-91fb-3c9e16d918d9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:05:30Z,use_quota=True,user_id='6c827d1857e14b91a804b06cfa0b70da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75f143a-d034-43a1-bfe0-230ffbd1b6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75f143a-d034-43a1-bfe0-230ffbd1b6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:30 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca Jun 03 12:05:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1d8bd3-2eb3-4979-a923-f19a0e554332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:30 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1d8bd3-2eb3-4979-a923-f19a0e554332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '91aa4734-d9fa-4481-9f6a-7288e0632c67', 'volume_name': 'volume-91aa4734-d9fa-4481-9f6a-7288e0632c67', 'volume_size': 1, 'snapshot_id': '8feef30d-75e9-41fd-91fb-3c9e16d918d9'}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52905914-de86-4391-a7ba-a6bac7947ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52905914-de86-4391-a7ba-a6bac7947ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2acfbff-68f1-4fce-80ed-9e43e0ed4fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:30 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Volume 91aa4734-d9fa-4481-9f6a-7288e0632c67: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-91aa4734-d9fa-4481-9f6a-7288e0632c67', 'volume_size': 1, 'snapshot_id': '8feef30d-75e9-41fd-91fb-3c9e16d918d9'} Jun 03 12:05:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:30 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca" returned: 0 in 0.897s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:30 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b402ca62-98ea-4d55-8b19-8935f6ce6252(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:05:30 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] will copy from snapshot at /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 12:05:30 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Creating direct copy from snapshot {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 12:05:30 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d82f60f-ab88-49f2-81d3-f144977b2e04]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:31 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 Jun 03 12:05:31 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:31 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-19165773-9fed-497d-b884-75e0031a82cc req-f1f5163d-0fbd-4c33-bc7d-d30a5b515884 tempest-TestShelveInstance-1271863328 None] Terminate volume connection completed successfully. Jun 03 12:05:31 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-19165773-9fed-497d-b884-75e0031a82cc req-f1f5163d-0fbd-4c33-bc7d-d30a5b515884 tempest-TestShelveInstance-1271863328 None] Deleting attachment f58c4c67-c62c-428b-8a10-f90fe3b74f04. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 12:05:31 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252" returned: 0 in 0.767s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:31 devstack cinder-volume[86724]: DEBUG cinder.utils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Path /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64 not found in is_blk_device check {{(pid=86724) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 03 12:05:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:31 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64 Jun 03 12:05:31 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 12:05:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:05:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:05:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:37 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:05:37 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:37 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64" returned: 0 in 6.083s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:37 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20de767-509c-4e9a-89b6-c20d37a5e58e]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:37 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 Jun 03 12:05:37 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:38 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.023s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:38 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:05:39 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252" returned: 0 in 1.258s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:39 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Image conversion details: src /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252, size 1024.00 MB, duration 6.08 sec, destination /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64 {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 12:05:39 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Converted 1024.00 MB image at 168.30 MB/s Jun 03 12:05:39 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64 is being set with open permissions: ugo+rw Jun 03 12:05:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:39 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64 Jun 03 12:05:39 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-092f93e1-9767-4d26-a2b0-3148b1e947d5 req-c2447b3f-e0f2-449d-bd0c-508a41f76a03 tempest-TestShelveInstance-1271863328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:39 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64" returned: 0 in 0.884s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Lock "cinder-quobyte-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64" released by "_copy_volume_from_snapshot" :: held 10.001s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:05:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Acquiring lock "cinder-quobyte-7cdc5d91-f410-4472-a9a7-992a5ddcbcca" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:05:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Lock "cinder-quobyte-7cdc5d91-f410-4472-a9a7-992a5ddcbcca" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:05:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Deleting offline snapshot 7cdc5d91-f410-4472-a9a7-992a5ddcbcca of volume b402ca62-98ea-4d55-8b19-8935f6ce6252 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 12:05:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] snapshot_file for this snap is: volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 12:05:40 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbae991a-1b79-447d-bcf3-7ed6f989d701]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:40 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca Jun 03 12:05:40 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:40 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca" returned: 0 in 0.814s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b402ca62-98ea-4d55-8b19-8935f6ce6252(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:05:40 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4428d0-e243-4aa9-b0cd-2b91ee170f90]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:41 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 Jun 03 12:05:41 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:41 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252" returned: 0 in 0.775s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:41 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca Jun 03 12:05:41 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:42 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca" returned: 0 in 0.756s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:42 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca Jun 03 12:05:42 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:43 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252.7cdc5d91-f410-4472-a9a7-992a5ddcbcca" returned: 0 in 0.632s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:43 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Lock "cinder-quobyte-7cdc5d91-f410-4472-a9a7-992a5ddcbcca" released by "_delete_snapshot" :: held 3.095s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:05:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.829s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.829s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-563621653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6fc47f-098f-4029-aa81-4d471a6c0228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3c7f78fb6e47c19b0cfb3f017f13d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:05:29Z,use_quota=True,user_id='c6e22748fe934eb7a842d689e157e84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:05:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Creating volume de6fc47f-098f-4029-aa81-4d471a6c0228 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:05:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:05:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:05:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:05:43 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:05:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-de6fc47f-098f-4029-aa81-4d471a6c0228 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:43 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-de6fc47f-098f-4029-aa81-4d471a6c0228 1073741824 Jun 03 12:05:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0dc7b3e-811b-47e5-bb81-34ec19e2130f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64', 'volume_size': 2, 'source_volid': 'b402ca62-98ea-4d55-8b19-8935f6ce6252', 'source_volstatus': 'available'}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:43 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ef2ab7-2430-4f4f-8c06-966d5e70d3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:43 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Volume volume-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64 (c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64): created successfully Jun 03 12:05:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ef2ab7-2430-4f4f-8c06-966d5e70d3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Flow 'volume_create_manager' (abcbf3b0-9429-4632-9a69-0ee4829e8a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:05:43 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a312f299-8818-4b3f-85cc-86bd82a88dfa tempest-VolumesCloneTest-414782612 None] Created volume successfully. Jun 03 12:05:43 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-de6fc47f-098f-4029-aa81-4d471a6c0228 1073741824" returned: 0 in 0.834s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-de6fc47f-098f-4029-aa81-4d471a6c0228 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:44 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-de6fc47f-098f-4029-aa81-4d471a6c0228 Jun 03 12:05:44 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:44 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fe906cdd-f444-4353-94a9-2df1ab8c21bc tempest-VolumesCloneTest-414782612 None] Acquiring lock "cinder-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:05:44 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fe906cdd-f444-4353-94a9-2df1ab8c21bc tempest-VolumesCloneTest-414782612 None] Lock "cinder-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:05:44 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=73,cinder:UPDATE=82,cinder:DELETE=5,cinder:INSERT=20 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:05:44 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=65,cinder:UPDATE=75,cinder:INSERT=15,cinder:DELETE=9 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:05:44 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fe906cdd-f444-4353-94a9-2df1ab8c21bc tempest-VolumesCloneTest-414782612 None] Acquiring lock "cinder-quobyte-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:05:44 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fe906cdd-f444-4353-94a9-2df1ab8c21bc tempest-VolumesCloneTest-414782612 None] Lock "cinder-quobyte-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64" acquired by "delete_volume" :: waited 0.029s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:05:44 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f67539-1139-45c6-9a11-674be27e5a1b]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fe906cdd-f444-4353-94a9-2df1ab8c21bc tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:44 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64 Jun 03 12:05:44 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:45 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-de6fc47f-098f-4029-aa81-4d471a6c0228" returned: 0 in 1.035s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 14.884s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Acquiring lock "cinder-quobyte-8feef30d-75e9-41fd-91fb-3c9e16d918d9-91aa4734-d9fa-4481-9f6a-7288e0632c67" by "_create_volume_from_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397f4a2e-b721-46ac-9040-c7ddcb903cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de6fc47f-098f-4029-aa81-4d471a6c0228', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8121a553-5e71-4f6b-9349-5020c9c6232b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Lock "cinder-quobyte-8feef30d-75e9-41fd-91fb-3c9e16d918d9-91aa4734-d9fa-4481-9f6a-7288e0632c67" acquired by "_create_volume_from_snapshot" :: waited 0.063s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Creating volume 91aa4734-d9fa-4481-9f6a-7288e0632c67 from snapshot 8feef30d-75e9-41fd-91fb-3c9e16d918d9 {{(pid=86724) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Acquiring lock "cinder-quobyte-91aa4734-d9fa-4481-9f6a-7288e0632c67" by "_copy_volume_from_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:05:45 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Volume volume-de6fc47f-098f-4029-aa81-4d471a6c0228 (de6fc47f-098f-4029-aa81-4d471a6c0228): created successfully Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8121a553-5e71-4f6b-9349-5020c9c6232b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Flow 'volume_create_manager' (aed0a68d-6886-4c11-b562-ba144316ac43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:05:45 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-0c9b3964-9e3a-49ab-abe4-d7347e4b9ec4 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Created volume successfully. Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Lock "cinder-quobyte-91aa4734-d9fa-4481-9f6a-7288e0632c67" acquired by "_copy_volume_from_snapshot" :: waited 0.076s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] snapshot: 8feef30d-75e9-41fd-91fb-3c9e16d918d9, volume: 91aa4734-d9fa-4481-9f6a-7288e0632c67, {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[97392cca-e4e6-43e1-b382-8264503fd357]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:45 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9 Jun 03 12:05:45 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:45 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fe906cdd-f444-4353-94a9-2df1ab8c21bc tempest-VolumesCloneTest-414782612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64" returned: 0 in 1.155s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fe906cdd-f444-4353-94a9-2df1ab8c21bc tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:45 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64 Jun 03 12:05:45 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:46 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:05:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Flow 'volume_create_manager' (42e654bc-df6b-466c-b28d-f61f23ec924c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:05:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59e01d6-da03-4b1c-a825-9b5559da4a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59e01d6-da03-4b1c-a825-9b5559da4a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2000020513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbb5c5a9-3b7a-465f-aa1b-ce343926f328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3c7f78fb6e47c19b0cfb3f017f13d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:05:46Z,use_quota=True,user_id='c6e22748fe934eb7a842d689e157e84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d85356e-5203-4b31-9f3e-a29150dd3bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d85356e-5203-4b31-9f3e-a29150dd3bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879bd996-74d0-40c4-86db-1918f23995d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879bd996-74d0-40c4-86db-1918f23995d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbb5c5a9-3b7a-465f-aa1b-ce343926f328', 'volume_name': 'volume-fbb5c5a9-3b7a-465f-aa1b-ce343926f328', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7f8776-cb40-4134-ad7d-b39f52e112f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7f8776-cb40-4134-ad7d-b39f52e112f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:46 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef61e9a5-6625-4376-84da-35803c833e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:46 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Volume fbb5c5a9-3b7a-465f-aa1b-ce343926f328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbb5c5a9-3b7a-465f-aa1b-ce343926f328', 'volume_size': 1} Jun 03 12:05:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:46 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9" returned: 0 in 1.408s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:46 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ea71870-0942-46ae-a0e0-7ad16892a113(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:05:46 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] will copy from snapshot at /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 12:05:46 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Creating direct copy from snapshot {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 12:05:46 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6369bb-fb71-448c-97a3-77b723ffffbc]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:46 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fe906cdd-f444-4353-94a9-2df1ab8c21bc tempest-VolumesCloneTest-414782612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64" returned: 0 in 1.238s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:46 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fe906cdd-f444-4353-94a9-2df1ab8c21bc tempest-VolumesCloneTest-414782612 None] Lock "cinder-quobyte-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64" released by "delete_volume" :: held 2.463s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:05:46 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-fe906cdd-f444-4353-94a9-2df1ab8c21bc tempest-VolumesCloneTest-414782612 None] Created reservations ['fb7bcb5a-6b88-46e7-963c-0a8c4994e48e', '69a76260-1f79-4551-b58f-470a3018e94d', '21def783-a01c-495d-8448-60e4169209ce', '5c51525e-b60e-4ffd-b566-a3f34904a092'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:05:47 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 Jun 03 12:05:47 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:47 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:05:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Flow 'volume_create_manager' (86978101-511f-4c38-b9a7-369a3365c009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:05:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ebf2b2-abff-4e24-9ea1-4cc245a17306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ebf2b2-abff-4e24-9ea1-4cc245a17306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-819817301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=366f9051-d8cd-494c-8715-b29453710db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3c7f78fb6e47c19b0cfb3f017f13d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:05:47Z,use_quota=True,user_id='c6e22748fe934eb7a842d689e157e84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e76f87-4121-42db-a06f-77f8a9010a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e76f87-4121-42db-a06f-77f8a9010a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980a3ef3-24ef-4d73-81de-d5d8d412b02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980a3ef3-24ef-4d73-81de-d5d8d412b02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '366f9051-d8cd-494c-8715-b29453710db9', 'volume_name': 'volume-366f9051-d8cd-494c-8715-b29453710db9', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd8e2289-f89d-44ed-8127-620c926bbc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd8e2289-f89d-44ed-8127-620c926bbc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c836e0-fe66-4a8b-9d76-f91e679b4abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:47 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Volume 366f9051-d8cd-494c-8715-b29453710db9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-366f9051-d8cd-494c-8715-b29453710db9', 'volume_size': 1} Jun 03 12:05:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fe906cdd-f444-4353-94a9-2df1ab8c21bc tempest-VolumesCloneTest-414782612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fe906cdd-f444-4353-94a9-2df1ab8c21bc tempest-VolumesCloneTest-414782612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fe906cdd-f444-4353-94a9-2df1ab8c21bc tempest-VolumesCloneTest-414782612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:05:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fe906cdd-f444-4353-94a9-2df1ab8c21bc tempest-VolumesCloneTest-414782612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:05:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fe906cdd-f444-4353-94a9-2df1ab8c21bc tempest-VolumesCloneTest-414782612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fe906cdd-f444-4353-94a9-2df1ab8c21bc tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:47 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:05:47 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:47 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:05:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Flow 'volume_create_manager' (f4cbfb34-3fed-4089-ad83-b42d100ce102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:05:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681b0d8b-f89f-405f-a15a-cc19286d4274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681b0d8b-f89f-405f-a15a-cc19286d4274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2143100222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b668b78-87d7-4514-90b7-fde8348e511e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3c7f78fb6e47c19b0cfb3f017f13d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:05:48Z,use_quota=True,user_id='c6e22748fe934eb7a842d689e157e84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9aa7aa-508f-46e5-815e-ab51ce18ec04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9aa7aa-508f-46e5-815e-ab51ce18ec04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406f6a4e-a08c-4e29-856c-56a401a27002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406f6a4e-a08c-4e29-856c-56a401a27002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b668b78-87d7-4514-90b7-fde8348e511e', 'volume_name': 'volume-0b668b78-87d7-4514-90b7-fde8348e511e', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896ea8ec-a217-4b9c-99ae-3ca8cf60cfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896ea8ec-a217-4b9c-99ae-3ca8cf60cfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0522d9af-1105-45c2-afdf-9db53700b06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:48 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Volume 0b668b78-87d7-4514-90b7-fde8348e511e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b668b78-87d7-4514-90b7-fde8348e511e', 'volume_size': 1} Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:48 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113" returned: 0 in 1.493s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG cinder.utils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Path /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-91aa4734-d9fa-4481-9f6a-7288e0632c67 not found in is_blk_device check {{(pid=86724) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-91aa4734-d9fa-4481-9f6a-7288e0632c67 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:48 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-91aa4734-d9fa-4481-9f6a-7288e0632c67 Jun 03 12:05:48 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:48 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fe906cdd-f444-4353-94a9-2df1ab8c21bc tempest-VolumesCloneTest-414782612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.266s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-fe906cdd-f444-4353-94a9-2df1ab8c21bc tempest-VolumesCloneTest-414782612 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:05:48 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-fe906cdd-f444-4353-94a9-2df1ab8c21bc tempest-VolumesCloneTest-414782612 None] Deleted volume successfully. Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Flow 'volume_create_manager' (268f857c-6ad8-4b43-9517-a160ba39de46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4836bf05-5cc8-4436-981c-82f94e1034a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fe906cdd-f444-4353-94a9-2df1ab8c21bc tempest-VolumesCloneTest-414782612 None] Lock "cinder-c2b75fbf-14b8-4b3c-8dc9-6bcb10731a64-delete_volume" released by "delete_volume" :: held 4.488s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4836bf05-5cc8-4436-981c-82f94e1034a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1104149178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e933bd-eb5a-495d-99e1-4d2d4a77958b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3c7f78fb6e47c19b0cfb3f017f13d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:05:48Z,use_quota=True,user_id='c6e22748fe934eb7a842d689e157e84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8e431f-3431-43b7-8362-37317c16a867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8e431f-3431-43b7-8362-37317c16a867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7803df-e0ed-48f8-bafb-abbce6795644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7803df-e0ed-48f8-bafb-abbce6795644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6e933bd-eb5a-495d-99e1-4d2d4a77958b', 'volume_name': 'volume-f6e933bd-eb5a-495d-99e1-4d2d4a77958b', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e21f0e-bd9e-4ffe-9ef7-ff1af778004e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e21f0e-bd9e-4ffe-9ef7-ff1af778004e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a55500-4ace-491a-9710-dbb0aa6b2d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:49 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Volume f6e933bd-eb5a-495d-99e1-4d2d4a77958b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6e933bd-eb5a-495d-99e1-4d2d4a77958b', 'volume_size': 1} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-234a0803-4940-4dd6-8681-5f96ca69e21e tempest-VolumesCloneTest-414782612 None] Acquiring lock "cinder-b402ca62-98ea-4d55-8b19-8935f6ce6252-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-234a0803-4940-4dd6-8681-5f96ca69e21e tempest-VolumesCloneTest-414782612 None] Lock "cinder-b402ca62-98ea-4d55-8b19-8935f6ce6252-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Flow 'volume_create_manager' (5cab26ea-4fdc-46ca-9982-d26fcc73c599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb5ed95-0188-4583-b80c-1f585e0eea31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb5ed95-0188-4583-b80c-1f585e0eea31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-446397512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3c7f78fb6e47c19b0cfb3f017f13d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:05:49Z,use_quota=True,user_id='c6e22748fe934eb7a842d689e157e84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7dc2bbf-3c42-418c-99d2-9baf383d6f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7dc2bbf-3c42-418c-99d2-9baf383d6f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d945b90-7a8d-4caa-8ac5-b56016ed34c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d945b90-7a8d-4caa-8ac5-b56016ed34c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf', 'volume_name': 'volume-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2845bf97-54d0-4fec-b11f-4a223d5c70c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2845bf97-54d0-4fec-b11f-4a223d5c70c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b170c2c-b0d7-46ad-8b77-08b65e55e4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:49 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Volume e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf', 'volume_size': 1} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-234a0803-4940-4dd6-8681-5f96ca69e21e tempest-VolumesCloneTest-414782612 None] Acquiring lock "cinder-quobyte-b402ca62-98ea-4d55-8b19-8935f6ce6252" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-234a0803-4940-4dd6-8681-5f96ca69e21e tempest-VolumesCloneTest-414782612 None] Lock "cinder-quobyte-b402ca62-98ea-4d55-8b19-8935f6ce6252" acquired by "delete_volume" :: waited 0.028s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aaa9768-df87-4480-82b8-2513a94580ee]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-234a0803-4940-4dd6-8681-5f96ca69e21e tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:49 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 Jun 03 12:05:49 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:51 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-234a0803-4940-4dd6-8681-5f96ca69e21e tempest-VolumesCloneTest-414782612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252" returned: 0 in 2.088s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-234a0803-4940-4dd6-8681-5f96ca69e21e tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:51 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252 Jun 03 12:05:51 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:54 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-234a0803-4940-4dd6-8681-5f96ca69e21e tempest-VolumesCloneTest-414782612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b402ca62-98ea-4d55-8b19-8935f6ce6252" returned: 0 in 2.411s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-234a0803-4940-4dd6-8681-5f96ca69e21e tempest-VolumesCloneTest-414782612 None] Lock "cinder-quobyte-b402ca62-98ea-4d55-8b19-8935f6ce6252" released by "delete_volume" :: held 4.640s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:05:54 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-234a0803-4940-4dd6-8681-5f96ca69e21e tempest-VolumesCloneTest-414782612 None] Created reservations ['ace37f17-6537-4cf8-9cd2-988283a34fdc', 'dd6e21d9-4a97-4e23-8d05-f46552113861', '1ad16ad3-c90a-4544-af08-d2fcb62cbe70', 'f80db7bc-a3e6-4160-815e-232855f962ed'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:05:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-234a0803-4940-4dd6-8681-5f96ca69e21e tempest-VolumesCloneTest-414782612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:05:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-234a0803-4940-4dd6-8681-5f96ca69e21e tempest-VolumesCloneTest-414782612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:54 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-234a0803-4940-4dd6-8681-5f96ca69e21e tempest-VolumesCloneTest-414782612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:05:54 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-234a0803-4940-4dd6-8681-5f96ca69e21e tempest-VolumesCloneTest-414782612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:05:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-234a0803-4940-4dd6-8681-5f96ca69e21e tempest-VolumesCloneTest-414782612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-234a0803-4940-4dd6-8681-5f96ca69e21e tempest-VolumesCloneTest-414782612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:54 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:05:54 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:56 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-234a0803-4940-4dd6-8681-5f96ca69e21e tempest-VolumesCloneTest-414782612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.695s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:56 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-234a0803-4940-4dd6-8681-5f96ca69e21e tempest-VolumesCloneTest-414782612 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:05:56 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-234a0803-4940-4dd6-8681-5f96ca69e21e tempest-VolumesCloneTest-414782612 None] Deleted volume successfully. Jun 03 12:05:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-234a0803-4940-4dd6-8681-5f96ca69e21e tempest-VolumesCloneTest-414782612 None] Lock "cinder-b402ca62-98ea-4d55-8b19-8935f6ce6252-delete_volume" released by "delete_volume" :: held 7.136s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:05:56 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-91aa4734-d9fa-4481-9f6a-7288e0632c67" returned: 0 in 8.345s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:56 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[984942bd-7762-44fd-843b-e9f2665711cd]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:56 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 Jun 03 12:05:56 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:57 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113" returned: 0 in 1.134s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:57 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Image conversion details: src /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113, size 1024.00 MB, duration 8.35 sec, destination /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-91aa4734-d9fa-4481-9f6a-7288e0632c67 {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 12:05:57 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Converted 1024.00 MB image at 122.69 MB/s Jun 03 12:05:57 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-91aa4734-d9fa-4481-9f6a-7288e0632c67 is being set with open permissions: ugo+rw Jun 03 12:05:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-91aa4734-d9fa-4481-9f6a-7288e0632c67 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:57 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-91aa4734-d9fa-4481-9f6a-7288e0632c67 Jun 03 12:05:57 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:58 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-91aa4734-d9fa-4481-9f6a-7288e0632c67" returned: 0 in 0.669s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:58 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Lock "cinder-quobyte-91aa4734-d9fa-4481-9f6a-7288e0632c67" released by "_copy_volume_from_snapshot" :: held 13.235s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:05:58 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Lock "cinder-quobyte-8feef30d-75e9-41fd-91fb-3c9e16d918d9-91aa4734-d9fa-4481-9f6a-7288e0632c67" released by "_create_volume_from_snapshot" :: held 13.346s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:05:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.411s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:05:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-092f93e1-9767-4d26-a2b0-3148b1e947d5 req-c2447b3f-e0f2-449d-bd0c-508a41f76a03 tempest-TestShelveInstance-1271863328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 18.923s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:05:58 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2acfbff-68f1-4fce-80ed-9e43e0ed4fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91aa4734-d9fa-4481-9f6a-7288e0632c67', 'volume_size': 1, 'snapshot_id': '8feef30d-75e9-41fd-91fb-3c9e16d918d9'}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:58 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5539b53c-f4fd-48a0-8fcc-5390f5e33478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:58 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c30c88-b4ff-423e-9e7a-0494cb9aa783]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:05:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-092f93e1-9767-4d26-a2b0-3148b1e947d5 req-c2447b3f-e0f2-449d-bd0c-508a41f76a03 tempest-TestShelveInstance-1271863328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:58 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Volume volume-91aa4734-d9fa-4481-9f6a-7288e0632c67 (91aa4734-d9fa-4481-9f6a-7288e0632c67): created successfully Jun 03 12:05:58 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5539b53c-f4fd-48a0-8fcc-5390f5e33478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:58 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Flow 'volume_create_manager' (1606a772-5bec-44cc-a60d-95c581bedb75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:05:58 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-b3f65526-a30b-48a2-929c-ea6689ab3939 tempest-TestStampPattern-576404759 None] Created volume successfully. Jun 03 12:05:58 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 Jun 03 12:05:58 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:59 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Jun 03 12:05:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-092f93e1-9767-4d26-a2b0-3148b1e947d5 req-c2447b3f-e0f2-449d-bd0c-508a41f76a03 tempest-TestShelveInstance-1271863328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96" returned: 0 in 0.975s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:05:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-092f93e1-9767-4d26-a2b0-3148b1e947d5 req-c2447b3f-e0f2-449d-bd0c-508a41f76a03 tempest-TestShelveInstance-1271863328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:05:59 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 Jun 03 12:05:59 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:05:59 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:05:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Flow 'volume_create_manager' (6bd987ad-5763-43d6-b056-6a2c34dd3ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:05:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5a4137-de8d-4aba-9323-835c680a8f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5a4137-de8d-4aba-9323-835c680a8f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1327667273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7506382b813e4cbe853ea7b5909b6dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:06:00Z,use_quota=True,user_id='7290f6607c52414ba321c08a12ed1aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:05:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18931acb-dd80-478f-a8db-480333b5a75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:05:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18931acb-dd80-478f-a8db-480333b5a75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe425e4-74da-4c70-b23d-e251772bb7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:06:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe425e4-74da-4c70-b23d-e251772bb7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35', 'volume_name': 'volume-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b02f58-c062-4add-9290-169552f6820d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:06:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b02f58-c062-4add-9290-169552f6820d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3290deb7-c2e8-478b-bd6c-3cbb471f2140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:06:00 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Volume cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35', 'volume_size': 1} Jun 03 12:06:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:00 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-092f93e1-9767-4d26-a2b0-3148b1e947d5 req-c2447b3f-e0f2-449d-bd0c-508a41f76a03 tempest-TestShelveInstance-1271863328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96" returned: 1 in 0.826s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-092f93e1-9767-4d26-a2b0-3148b1e947d5 req-c2447b3f-e0f2-449d-bd0c-508a41f76a03 tempest-TestShelveInstance-1271863328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:06:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-092f93e1-9767-4d26-a2b0-3148b1e947d5 req-c2447b3f-e0f2-449d-bd0c-508a41f76a03 tempest-TestShelveInstance-1271863328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.908s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.684s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2000020513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbb5c5a9-3b7a-465f-aa1b-ce343926f328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3c7f78fb6e47c19b0cfb3f017f13d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:05:46Z,use_quota=True,user_id='c6e22748fe934eb7a842d689e157e84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:06:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Creating volume fbb5c5a9-3b7a-465f-aa1b-ce343926f328 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:06:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:06:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:06:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:06:00 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:06:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fbb5c5a9-3b7a-465f-aa1b-ce343926f328 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:00 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fbb5c5a9-3b7a-465f-aa1b-ce343926f328 1073741824 Jun 03 12:06:00 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-092f93e1-9767-4d26-a2b0-3148b1e947d5 req-c2447b3f-e0f2-449d-bd0c-508a41f76a03 tempest-TestShelveInstance-1271863328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-135f9f69-b862-408e-968f-21bc59fa6d96', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe568b07-5c86-41ad-b261-55911e5eac94', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 12:06:00 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-092f93e1-9767-4d26-a2b0-3148b1e947d5 req-c2447b3f-e0f2-449d-bd0c-508a41f76a03 tempest-TestShelveInstance-1271863328 None] attachment_update completed successfully. Jun 03 12:06:01 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fbb5c5a9-3b7a-465f-aa1b-ce343926f328 1073741824" returned: 0 in 0.794s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fbb5c5a9-3b7a-465f-aa1b-ce343926f328 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:01 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fbb5c5a9-3b7a-465f-aa1b-ce343926f328 Jun 03 12:06:01 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:01 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fbb5c5a9-3b7a-465f-aa1b-ce343926f328" returned: 0 in 0.616s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:06:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.611s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-819817301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=366f9051-d8cd-494c-8715-b29453710db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3c7f78fb6e47c19b0cfb3f017f13d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:05:47Z,use_quota=True,user_id='c6e22748fe934eb7a842d689e157e84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:06:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Creating volume 366f9051-d8cd-494c-8715-b29453710db9 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:06:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:06:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:06:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:06:01 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:06:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-366f9051-d8cd-494c-8715-b29453710db9 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef61e9a5-6625-4376-84da-35803c833e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbb5c5a9-3b7a-465f-aa1b-ce343926f328', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:01 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-366f9051-d8cd-494c-8715-b29453710db9 1073741824 Jun 03 12:06:01 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e8fcea-d052-4a62-9e63-0735730f8d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:06:01 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Volume volume-fbb5c5a9-3b7a-465f-aa1b-ce343926f328 (fbb5c5a9-3b7a-465f-aa1b-ce343926f328): created successfully Jun 03 12:06:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e8fcea-d052-4a62-9e63-0735730f8d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Flow 'volume_create_manager' (42e654bc-df6b-466c-b28d-f61f23ec924c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:06:01 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-2cdca242-ec12-40c8-aff7-c903db61b2e7 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Created volume successfully. Jun 03 12:06:02 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-366f9051-d8cd-494c-8715-b29453710db9 1073741824" returned: 0 in 0.821s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-366f9051-d8cd-494c-8715-b29453710db9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:02 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-366f9051-d8cd-494c-8715-b29453710db9 Jun 03 12:06:02 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:03 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-366f9051-d8cd-494c-8715-b29453710db9" returned: 0 in 0.616s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:06:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.186s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2143100222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b668b78-87d7-4514-90b7-fde8348e511e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3c7f78fb6e47c19b0cfb3f017f13d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:05:48Z,use_quota=True,user_id='c6e22748fe934eb7a842d689e157e84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:06:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Creating volume 0b668b78-87d7-4514-90b7-fde8348e511e {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:06:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:06:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:06:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:06:03 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:06:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0b668b78-87d7-4514-90b7-fde8348e511e 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:03 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c836e0-fe66-4a8b-9d76-f91e679b4abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-366f9051-d8cd-494c-8715-b29453710db9', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:03 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0b668b78-87d7-4514-90b7-fde8348e511e 1073741824 Jun 03 12:06:03 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7c4c4b-c16e-4846-a717-0550377e0179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:06:03 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:03 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Volume volume-366f9051-d8cd-494c-8715-b29453710db9 (366f9051-d8cd-494c-8715-b29453710db9): created successfully Jun 03 12:06:03 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7c4c4b-c16e-4846-a717-0550377e0179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:03 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Flow 'volume_create_manager' (86978101-511f-4c38-b9a7-369a3365c009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:06:03 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a30337ec-16ff-4dbc-882e-c55f3928f759 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Created volume successfully. Jun 03 12:06:04 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0b668b78-87d7-4514-90b7-fde8348e511e 1073741824" returned: 0 in 0.869s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0b668b78-87d7-4514-90b7-fde8348e511e {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:04 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0b668b78-87d7-4514-90b7-fde8348e511e Jun 03 12:06:04 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:04 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0b668b78-87d7-4514-90b7-fde8348e511e" returned: 0 in 0.595s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:04 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:06:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.837s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:04 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1104149178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e933bd-eb5a-495d-99e1-4d2d4a77958b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3c7f78fb6e47c19b0cfb3f017f13d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:05:48Z,use_quota=True,user_id='c6e22748fe934eb7a842d689e157e84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:06:04 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Creating volume f6e933bd-eb5a-495d-99e1-4d2d4a77958b {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:06:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:04 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:06:04 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:06:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:04 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:06:04 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:06:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f6e933bd-eb5a-495d-99e1-4d2d4a77958b 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:04 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f6e933bd-eb5a-495d-99e1-4d2d4a77958b 1073741824 Jun 03 12:06:04 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0522d9af-1105-45c2-afdf-9db53700b06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b668b78-87d7-4514-90b7-fde8348e511e', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e807aba7-da0c-439b-baad-913deffde911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:06:04 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Volume volume-0b668b78-87d7-4514-90b7-fde8348e511e (0b668b78-87d7-4514-90b7-fde8348e511e): created successfully Jun 03 12:06:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e807aba7-da0c-439b-baad-913deffde911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Flow 'volume_create_manager' (f4cbfb34-3fed-4089-ad83-b42d100ce102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:06:04 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c190a84a-15e1-4c99-bf97-befc4da5972a tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Created volume successfully. Jun 03 12:06:05 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f6e933bd-eb5a-495d-99e1-4d2d4a77958b 1073741824" returned: 0 in 0.871s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f6e933bd-eb5a-495d-99e1-4d2d4a77958b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:05 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f6e933bd-eb5a-495d-99e1-4d2d4a77958b Jun 03 12:06:05 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:06 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f6e933bd-eb5a-495d-99e1-4d2d4a77958b" returned: 0 in 0.633s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:06:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.832s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-446397512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3c7f78fb6e47c19b0cfb3f017f13d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:05:49Z,use_quota=True,user_id='c6e22748fe934eb7a842d689e157e84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:06:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Creating volume e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:06:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:06:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:06:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:06:06 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:06:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:06 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a55500-4ace-491a-9710-dbb0aa6b2d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6e933bd-eb5a-495d-99e1-4d2d4a77958b', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:06 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b8fc671-099a-4669-8c85-7904e7456db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:06:06 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf 1073741824 Jun 03 12:06:06 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:06 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Volume volume-f6e933bd-eb5a-495d-99e1-4d2d4a77958b (f6e933bd-eb5a-495d-99e1-4d2d4a77958b): created successfully Jun 03 12:06:06 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b8fc671-099a-4669-8c85-7904e7456db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:06 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Flow 'volume_create_manager' (268f857c-6ad8-4b43-9517-a160ba39de46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:06:06 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-18ab009b-3178-469e-9eac-6db61d6b9f12 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Created volume successfully. Jun 03 12:06:07 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf 1073741824" returned: 0 in 0.831s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:07 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf Jun 03 12:06:07 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:07 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf" returned: 0 in 0.626s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:06:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.879s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1327667273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7506382b813e4cbe853ea7b5909b6dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:06:00Z,use_quota=True,user_id='7290f6607c52414ba321c08a12ed1aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:06:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Creating volume cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:06:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:06:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:06:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:06:07 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:06:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b170c2c-b0d7-46ad-8b77-08b65e55e4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:07 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35 1073741824 Jun 03 12:06:07 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913100b0-e65f-47f4-a6f2-7b19ba73a737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:06:07 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Volume volume-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf (e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf): created successfully Jun 03 12:06:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913100b0-e65f-47f4-a6f2-7b19ba73a737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Flow 'volume_create_manager' (5cab26ea-4fdc-46ca-9982-d26fcc73c599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:06:07 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-942faf75-cde7-42b5-8b9f-63109c5a9618 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Created volume successfully. Jun 03 12:06:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a7ebb20c-a0f9-4087-a8ab-d038db39af79 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "cinder-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a7ebb20c-a0f9-4087-a8ab-d038db39af79 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:08 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a7ebb20c-a0f9-4087-a8ab-d038db39af79 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "cinder-quobyte-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35 1073741824" returned: 0 in 0.924s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a7ebb20c-a0f9-4087-a8ab-d038db39af79 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-quobyte-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf" acquired by "delete_volume" :: waited 0.033s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:08 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbef00a-ecb8-4d4a-be3f-d51d6d3f8c28]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:06:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a7ebb20c-a0f9-4087-a8ab-d038db39af79 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:08 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35 Jun 03 12:06:08 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:09 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf Jun 03 12:06:09 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:09 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35" returned: 0 in 0.681s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:06:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3290deb7-c2e8-478b-bd6c-3cbb471f2140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f73c32-e337-476e-9880-71bb7e3929a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:06:09 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Volume volume-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35 (cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35): created successfully Jun 03 12:06:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f73c32-e337-476e-9880-71bb7e3929a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Flow 'volume_create_manager' (6bd987ad-5763-43d6-b056-6a2c34dd3ab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:06:09 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-8b718ae1-69fb-49cc-9fbd-d9b728b39c32 tempest-VolumesNegativeTest-864037643 None] Created volume successfully. Jun 03 12:06:09 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a7ebb20c-a0f9-4087-a8ab-d038db39af79 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf" returned: 0 in 0.810s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a7ebb20c-a0f9-4087-a8ab-d038db39af79 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:09 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf Jun 03 12:06:09 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:10 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a7ebb20c-a0f9-4087-a8ab-d038db39af79 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf" returned: 0 in 0.631s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:10 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a7ebb20c-a0f9-4087-a8ab-d038db39af79 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-quobyte-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf" released by "delete_volume" :: held 1.494s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:10 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-a7ebb20c-a0f9-4087-a8ab-d038db39af79 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Created reservations ['81ab1cc8-11e3-4d6b-acc0-e6ab13594aac', 'ade52bb5-7f4a-4291-877b-0a74106efbe6', '41e93041-f743-4be4-ba5c-abe53907ef3a', 'ef8f4f22-a416-4c4e-8b4a-c4b8e4814e30'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:06:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a7ebb20c-a0f9-4087-a8ab-d038db39af79 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a7ebb20c-a0f9-4087-a8ab-d038db39af79 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a7ebb20c-a0f9-4087-a8ab-d038db39af79 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:06:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a7ebb20c-a0f9-4087-a8ab-d038db39af79 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:06:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a7ebb20c-a0f9-4087-a8ab-d038db39af79 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a7ebb20c-a0f9-4087-a8ab-d038db39af79 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:10 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:06:10 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:11 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c2622da0-30a7-4030-9c6b-26792ad46494 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "cinder-f6e933bd-eb5a-495d-99e1-4d2d4a77958b-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:11 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c2622da0-30a7-4030-9c6b-26792ad46494 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-f6e933bd-eb5a-495d-99e1-4d2d4a77958b-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:11 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c2622da0-30a7-4030-9c6b-26792ad46494 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "cinder-quobyte-f6e933bd-eb5a-495d-99e1-4d2d4a77958b" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:11 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c2622da0-30a7-4030-9c6b-26792ad46494 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-quobyte-f6e933bd-eb5a-495d-99e1-4d2d4a77958b" acquired by "delete_volume" :: waited 0.038s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:11 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8176e6a0-9533-49cb-aedb-4872141e1033]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:06:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c2622da0-30a7-4030-9c6b-26792ad46494 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f6e933bd-eb5a-495d-99e1-4d2d4a77958b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:11 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a7ebb20c-a0f9-4087-a8ab-d038db39af79 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.898s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:11 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-a7ebb20c-a0f9-4087-a8ab-d038db39af79 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:06:11 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a7ebb20c-a0f9-4087-a8ab-d038db39af79 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Deleted volume successfully. Jun 03 12:06:11 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a7ebb20c-a0f9-4087-a8ab-d038db39af79 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-e5c7b4b0-06e7-49fa-a620-bfbbacdfdebf-delete_volume" released by "delete_volume" :: held 2.694s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:11 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f6e933bd-eb5a-495d-99e1-4d2d4a77958b Jun 03 12:06:11 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:12 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c2622da0-30a7-4030-9c6b-26792ad46494 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f6e933bd-eb5a-495d-99e1-4d2d4a77958b" returned: 0 in 1.534s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c2622da0-30a7-4030-9c6b-26792ad46494 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f6e933bd-eb5a-495d-99e1-4d2d4a77958b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:12 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f6e933bd-eb5a-495d-99e1-4d2d4a77958b Jun 03 12:06:12 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:13 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c2622da0-30a7-4030-9c6b-26792ad46494 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f6e933bd-eb5a-495d-99e1-4d2d4a77958b" returned: 0 in 0.948s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:13 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c2622da0-30a7-4030-9c6b-26792ad46494 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-quobyte-f6e933bd-eb5a-495d-99e1-4d2d4a77958b" released by "delete_volume" :: held 2.593s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:13 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-c2622da0-30a7-4030-9c6b-26792ad46494 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Created reservations ['20338fce-6f04-4022-ae21-e69ecb3e211c', '42838270-683d-4de6-bd04-97e39d73a41f', '58ce704a-f8e8-4292-9b69-a13f20324e38', 'be402267-8e3d-4eba-a2ee-791af7020025'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:06:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c2622da0-30a7-4030-9c6b-26792ad46494 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c2622da0-30a7-4030-9c6b-26792ad46494 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:14 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c2622da0-30a7-4030-9c6b-26792ad46494 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:06:14 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c2622da0-30a7-4030-9c6b-26792ad46494 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:06:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c2622da0-30a7-4030-9c6b-26792ad46494 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c2622da0-30a7-4030-9c6b-26792ad46494 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:14 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:06:14 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:14 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-f75a891d-e6ca-4b16-b9df-055902c1e1fd tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "cinder-0b668b78-87d7-4514-90b7-fde8348e511e-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:14 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-f75a891d-e6ca-4b16-b9df-055902c1e1fd tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-0b668b78-87d7-4514-90b7-fde8348e511e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:14 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-f75a891d-e6ca-4b16-b9df-055902c1e1fd tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "cinder-quobyte-0b668b78-87d7-4514-90b7-fde8348e511e" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:14 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-f75a891d-e6ca-4b16-b9df-055902c1e1fd tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-quobyte-0b668b78-87d7-4514-90b7-fde8348e511e" acquired by "delete_volume" :: waited 0.021s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:14 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:14 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f78406-d2d4-4b39-9b75-3178b1f90554]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:06:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f75a891d-e6ca-4b16-b9df-055902c1e1fd tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0b668b78-87d7-4514-90b7-fde8348e511e {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c2622da0-30a7-4030-9c6b-26792ad46494 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.761s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:14 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-c2622da0-30a7-4030-9c6b-26792ad46494 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:06:14 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c2622da0-30a7-4030-9c6b-26792ad46494 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Deleted volume successfully. Jun 03 12:06:14 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c2622da0-30a7-4030-9c6b-26792ad46494 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-f6e933bd-eb5a-495d-99e1-4d2d4a77958b-delete_volume" released by "delete_volume" :: held 3.783s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:14 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0b668b78-87d7-4514-90b7-fde8348e511e Jun 03 12:06:14 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:15 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f75a891d-e6ca-4b16-b9df-055902c1e1fd tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0b668b78-87d7-4514-90b7-fde8348e511e" returned: 0 in 0.905s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f75a891d-e6ca-4b16-b9df-055902c1e1fd tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0b668b78-87d7-4514-90b7-fde8348e511e {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:15 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0b668b78-87d7-4514-90b7-fde8348e511e Jun 03 12:06:15 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:16 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f75a891d-e6ca-4b16-b9df-055902c1e1fd tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-0b668b78-87d7-4514-90b7-fde8348e511e" returned: 0 in 0.723s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-f75a891d-e6ca-4b16-b9df-055902c1e1fd tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-quobyte-0b668b78-87d7-4514-90b7-fde8348e511e" released by "delete_volume" :: held 1.697s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:16 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-f75a891d-e6ca-4b16-b9df-055902c1e1fd tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Created reservations ['fdb00e23-7056-4d96-85e3-cc664d19313d', '0b905d8f-1cae-4fb0-a8dd-799bdb0459a7', '56d37564-c290-4677-b92e-ccb366ee29b4', '1ca2de3f-2151-4f71-a924-56a2055e46b3'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:06:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f75a891d-e6ca-4b16-b9df-055902c1e1fd tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f75a891d-e6ca-4b16-b9df-055902c1e1fd tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:16 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f75a891d-e6ca-4b16-b9df-055902c1e1fd tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:06:16 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f75a891d-e6ca-4b16-b9df-055902c1e1fd tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:06:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f75a891d-e6ca-4b16-b9df-055902c1e1fd tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f75a891d-e6ca-4b16-b9df-055902c1e1fd tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:16 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:06:16 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-57614e72-e22e-4b52-b6b3-a3e67572ad14 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "cinder-366f9051-d8cd-494c-8715-b29453710db9-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-57614e72-e22e-4b52-b6b3-a3e67572ad14 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-366f9051-d8cd-494c-8715-b29453710db9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:17 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-57614e72-e22e-4b52-b6b3-a3e67572ad14 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "cinder-quobyte-366f9051-d8cd-494c-8715-b29453710db9" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:17 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-57614e72-e22e-4b52-b6b3-a3e67572ad14 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-quobyte-366f9051-d8cd-494c-8715-b29453710db9" acquired by "delete_volume" :: waited 0.032s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:17 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0414a4e-27ad-4a96-baf0-2e5921609d25]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:06:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-57614e72-e22e-4b52-b6b3-a3e67572ad14 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-366f9051-d8cd-494c-8715-b29453710db9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:17 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-366f9051-d8cd-494c-8715-b29453710db9 Jun 03 12:06:17 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:17 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f75a891d-e6ca-4b16-b9df-055902c1e1fd tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.789s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:17 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-f75a891d-e6ca-4b16-b9df-055902c1e1fd tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:06:17 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-f75a891d-e6ca-4b16-b9df-055902c1e1fd tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Deleted volume successfully. Jun 03 12:06:17 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-f75a891d-e6ca-4b16-b9df-055902c1e1fd tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-0b668b78-87d7-4514-90b7-fde8348e511e-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:18 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-57614e72-e22e-4b52-b6b3-a3e67572ad14 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-366f9051-d8cd-494c-8715-b29453710db9" returned: 0 in 1.261s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-57614e72-e22e-4b52-b6b3-a3e67572ad14 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-366f9051-d8cd-494c-8715-b29453710db9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:18 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-366f9051-d8cd-494c-8715-b29453710db9 Jun 03 12:06:18 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-b9a9b40d-d255-4c84-920b-e54d17c326c9 req-c48dc10b-1db1-4124-9b94-f91dd1b32651 tempest-TestStampPattern-576404759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-b9a9b40d-d255-4c84-920b-e54d17c326c9 req-c48dc10b-1db1-4124-9b94-f91dd1b32651 tempest-TestStampPattern-576404759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:18 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b03071-f7b8-4774-a5fc-d9ce4599aba0]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:06:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-b9a9b40d-d255-4c84-920b-e54d17c326c9 req-c48dc10b-1db1-4124-9b94-f91dd1b32651 tempest-TestStampPattern-576404759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-91aa4734-d9fa-4481-9f6a-7288e0632c67 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:19 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-91aa4734-d9fa-4481-9f6a-7288e0632c67 Jun 03 12:06:19 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:19 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-57614e72-e22e-4b52-b6b3-a3e67572ad14 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-366f9051-d8cd-494c-8715-b29453710db9" returned: 0 in 1.228s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:19 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-57614e72-e22e-4b52-b6b3-a3e67572ad14 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-quobyte-366f9051-d8cd-494c-8715-b29453710db9" released by "delete_volume" :: held 2.574s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:19 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-57614e72-e22e-4b52-b6b3-a3e67572ad14 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Created reservations ['205d5e67-d79c-4cce-a821-708440fcd4bf', 'e36c2935-58a6-4b0b-8fa7-150621de94dd', 'b8e5b32d-d1ff-4f28-80b8-e6cab5190e3f', 'a1fe7f6c-fa86-43e9-bfca-ae7673d61a63'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:06:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-57614e72-e22e-4b52-b6b3-a3e67572ad14 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-57614e72-e22e-4b52-b6b3-a3e67572ad14 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-57614e72-e22e-4b52-b6b3-a3e67572ad14 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:06:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-57614e72-e22e-4b52-b6b3-a3e67572ad14 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:06:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-57614e72-e22e-4b52-b6b3-a3e67572ad14 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-57614e72-e22e-4b52-b6b3-a3e67572ad14 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:20 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:06:20 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-b9a9b40d-d255-4c84-920b-e54d17c326c9 req-c48dc10b-1db1-4124-9b94-f91dd1b32651 tempest-TestStampPattern-576404759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-91aa4734-d9fa-4481-9f6a-7288e0632c67" returned: 0 in 1.387s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:20 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-b9a9b40d-d255-4c84-920b-e54d17c326c9 req-c48dc10b-1db1-4124-9b94-f91dd1b32651 tempest-TestStampPattern-576404759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.446s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:20 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-b9a9b40d-d255-4c84-920b-e54d17c326c9 req-c48dc10b-1db1-4124-9b94-f91dd1b32651 tempest-TestStampPattern-576404759 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-91aa4734-d9fa-4481-9f6a-7288e0632c67', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '632dc76c-a10a-472a-8e56-b5c8eb7575d5', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 12:06:20 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-b9a9b40d-d255-4c84-920b-e54d17c326c9 req-c48dc10b-1db1-4124-9b94-f91dd1b32651 tempest-TestStampPattern-576404759 None] attachment_update completed successfully. Jun 03 12:06:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-cd008721-b9e0-4ab7-8f30-7ede98460e89 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "cinder-fbb5c5a9-3b7a-465f-aa1b-ce343926f328-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-cd008721-b9e0-4ab7-8f30-7ede98460e89 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-fbb5c5a9-3b7a-465f-aa1b-ce343926f328-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-cd008721-b9e0-4ab7-8f30-7ede98460e89 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "cinder-quobyte-fbb5c5a9-3b7a-465f-aa1b-ce343926f328" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-cd008721-b9e0-4ab7-8f30-7ede98460e89 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-quobyte-fbb5c5a9-3b7a-465f-aa1b-ce343926f328" acquired by "delete_volume" :: waited 0.024s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:20 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df43307-ea25-4c4b-a4b2-f34125c3c729]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:06:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cd008721-b9e0-4ab7-8f30-7ede98460e89 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fbb5c5a9-3b7a-465f-aa1b-ce343926f328 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:21 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fbb5c5a9-3b7a-465f-aa1b-ce343926f328 Jun 03 12:06:21 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:21 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-57614e72-e22e-4b52-b6b3-a3e67572ad14 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.138s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:21 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-57614e72-e22e-4b52-b6b3-a3e67572ad14 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:06:21 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-57614e72-e22e-4b52-b6b3-a3e67572ad14 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Deleted volume successfully. Jun 03 12:06:21 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-57614e72-e22e-4b52-b6b3-a3e67572ad14 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-366f9051-d8cd-494c-8715-b29453710db9-delete_volume" released by "delete_volume" :: held 4.264s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:21 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cd008721-b9e0-4ab7-8f30-7ede98460e89 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fbb5c5a9-3b7a-465f-aa1b-ce343926f328" returned: 0 in 1.007s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cd008721-b9e0-4ab7-8f30-7ede98460e89 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fbb5c5a9-3b7a-465f-aa1b-ce343926f328 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:21 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fbb5c5a9-3b7a-465f-aa1b-ce343926f328 Jun 03 12:06:21 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:22 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cd008721-b9e0-4ab7-8f30-7ede98460e89 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fbb5c5a9-3b7a-465f-aa1b-ce343926f328" returned: 0 in 0.622s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-cd008721-b9e0-4ab7-8f30-7ede98460e89 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-quobyte-fbb5c5a9-3b7a-465f-aa1b-ce343926f328" released by "delete_volume" :: held 1.708s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:22 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-cd008721-b9e0-4ab7-8f30-7ede98460e89 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Created reservations ['f974762f-a52a-48f5-9194-c0a671023447', 'a07317c3-248b-498a-bfdc-564d9b59fc4f', 'bfe13302-c526-44b4-85be-c3797739d080', 'c43eff9d-1977-43b5-bd2b-a062b6826498'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:06:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cd008721-b9e0-4ab7-8f30-7ede98460e89 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cd008721-b9e0-4ab7-8f30-7ede98460e89 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-cd008721-b9e0-4ab7-8f30-7ede98460e89 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:06:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-cd008721-b9e0-4ab7-8f30-7ede98460e89 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:06:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-cd008721-b9e0-4ab7-8f30-7ede98460e89 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cd008721-b9e0-4ab7-8f30-7ede98460e89 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:22 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:06:22 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0aa238c4-fa1c-4f4b-bd58-72aa8c569f5f tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "cinder-de6fc47f-098f-4029-aa81-4d471a6c0228-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0aa238c4-fa1c-4f4b-bd58-72aa8c569f5f tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-de6fc47f-098f-4029-aa81-4d471a6c0228-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0aa238c4-fa1c-4f4b-bd58-72aa8c569f5f tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "cinder-quobyte-de6fc47f-098f-4029-aa81-4d471a6c0228" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0aa238c4-fa1c-4f4b-bd58-72aa8c569f5f tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-quobyte-de6fc47f-098f-4029-aa81-4d471a6c0228" acquired by "delete_volume" :: waited 0.044s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:23 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4502e20-8156-473a-bf5a-1a521f8992af]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:06:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0aa238c4-fa1c-4f4b-bd58-72aa8c569f5f tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-de6fc47f-098f-4029-aa81-4d471a6c0228 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:23 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-cd008721-b9e0-4ab7-8f30-7ede98460e89 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.737s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:23 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-cd008721-b9e0-4ab7-8f30-7ede98460e89 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:06:23 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-cd008721-b9e0-4ab7-8f30-7ede98460e89 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Deleted volume successfully. Jun 03 12:06:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-cd008721-b9e0-4ab7-8f30-7ede98460e89 tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-fbb5c5a9-3b7a-465f-aa1b-ce343926f328-delete_volume" released by "delete_volume" :: held 2.686s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:23 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-de6fc47f-098f-4029-aa81-4d471a6c0228 Jun 03 12:06:23 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:24 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0aa238c4-fa1c-4f4b-bd58-72aa8c569f5f tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-de6fc47f-098f-4029-aa81-4d471a6c0228" returned: 0 in 0.891s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0aa238c4-fa1c-4f4b-bd58-72aa8c569f5f tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-de6fc47f-098f-4029-aa81-4d471a6c0228 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:24 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-de6fc47f-098f-4029-aa81-4d471a6c0228 Jun 03 12:06:24 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:24 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0aa238c4-fa1c-4f4b-bd58-72aa8c569f5f tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-de6fc47f-098f-4029-aa81-4d471a6c0228" returned: 0 in 0.693s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0aa238c4-fa1c-4f4b-bd58-72aa8c569f5f tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-quobyte-de6fc47f-098f-4029-aa81-4d471a6c0228" released by "delete_volume" :: held 1.645s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:24 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-0aa238c4-fa1c-4f4b-bd58-72aa8c569f5f tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Created reservations ['b57ed349-befa-4a52-9a44-5ad68e4801ab', '9480e5eb-9b56-4341-8b92-ca9c961c8d90', '716fbf4d-a4ba-4781-948c-50765a8d97b3', '09074e41-fd6e-4d7a-bc7e-688b1dbbdcbe'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:06:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0aa238c4-fa1c-4f4b-bd58-72aa8c569f5f tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0aa238c4-fa1c-4f4b-bd58-72aa8c569f5f tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0aa238c4-fa1c-4f4b-bd58-72aa8c569f5f tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:06:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0aa238c4-fa1c-4f4b-bd58-72aa8c569f5f tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:06:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0aa238c4-fa1c-4f4b-bd58-72aa8c569f5f tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0aa238c4-fa1c-4f4b-bd58-72aa8c569f5f tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:24 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:06:24 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:25 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0aa238c4-fa1c-4f4b-bd58-72aa8c569f5f tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.739s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:25 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-0aa238c4-fa1c-4f4b-bd58-72aa8c569f5f tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:06:25 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-0aa238c4-fa1c-4f4b-bd58-72aa8c569f5f tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Deleted volume successfully. Jun 03 12:06:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0aa238c4-fa1c-4f4b-bd58-72aa8c569f5f tempest-CreateVolumesFromSourceVolumeTest-1859093283 None] Lock "cinder-de6fc47f-098f-4029-aa81-4d471a6c0228-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:28 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-3be418de-b14b-451a-880f-e79b844bb389 req-89786404-444a-49ab-9ccc-d97aa4223d0e tempest-TestStampPattern-576404759 None] Terminate volume connection completed successfully. Jun 03 12:06:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-3be418de-b14b-451a-880f-e79b844bb389 req-89786404-444a-49ab-9ccc-d97aa4223d0e tempest-TestStampPattern-576404759 None] Deleting attachment 632dc76c-a10a-472a-8e56-b5c8eb7575d5. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Flow 'volume_create_manager' (d94aba93-e1e7-4c07-9ad7-f6cf9a1c7649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2cbc5ad-de13-4049-b991-65e2879eb7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2cbc5ad-de13-4049-b991-65e2879eb7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1278448500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3300c21-96f5-4329-b50a-7b7a4f34cc64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b9cd96c2e8d4cc59e5ae63f0b5d9f69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:06:30Z,use_quota=True,user_id='81063b79b8f343dcae1b14626ec9355f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19df8be3-5019-46c7-8920-36199ce27cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19df8be3-5019-46c7-8920-36199ce27cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe23106-aff1-4b7d-b1f2-02603d379aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe23106-aff1-4b7d-b1f2-02603d379aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3300c21-96f5-4329-b50a-7b7a4f34cc64', 'volume_name': 'volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a12c7b-c50d-4b37-8f87-f2074e8f1d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a12c7b-c50d-4b37-8f87-f2074e8f1d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51596aa4-29fc-4ff1-8472-f1c24998866d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:06:30 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Volume d3300c21-96f5-4329-b50a-7b7a4f34cc64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64', 'volume_size': 1} Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1278448500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3300c21-96f5-4329-b50a-7b7a4f34cc64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b9cd96c2e8d4cc59e5ae63f0b5d9f69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:06:30Z,use_quota=True,user_id='81063b79b8f343dcae1b14626ec9355f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Creating volume d3300c21-96f5-4329-b50a-7b7a4f34cc64 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:06:30 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:06:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:30 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 1073741824 Jun 03 12:06:30 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:31 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 1073741824" returned: 0 in 1.515s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:31 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 Jun 03 12:06:31 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:33 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64" returned: 0 in 1.248s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:33 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] <== create_volume: return (2869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:06:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.876s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:33 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51596aa4-29fc-4ff1-8472-f1c24998866d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:33 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6094f526-5242-4e7a-a687-94d754d90f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:06:33 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Volume volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 (d3300c21-96f5-4329-b50a-7b7a4f34cc64): created successfully Jun 03 12:06:33 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6094f526-5242-4e7a-a687-94d754d90f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:33 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Flow 'volume_create_manager' (d94aba93-e1e7-4c07-9ad7-f6cf9a1c7649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:06:33 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-475b7435-a150-460c-947f-61f9c69030a7 tempest-VolumeDependencyTests-25904679 None] Created volume successfully. Jun 03 12:06:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3e5bc1af-9c63-4f15-b7d4-fed8618fdda9 tempest-VolumeDependencyTests-25904679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3e5bc1af-9c63-4f15-b7d4-fed8618fdda9 tempest-VolumeDependencyTests-25904679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:33 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-3e5bc1af-9c63-4f15-b7d4-fed8618fdda9 tempest-VolumeDependencyTests-25904679 None] Creating offline snapshot cb722857-a318-48a7-8b7a-aab524e35532 of volume d3300c21-96f5-4329-b50a-7b7a4f34cc64 {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 12:06:33 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7662fd-77fb-4b78-b39d-5af647f7eabc]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:06:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3e5bc1af-9c63-4f15-b7d4-fed8618fdda9 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:33 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 Jun 03 12:06:33 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:34 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3e5bc1af-9c63-4f15-b7d4-fed8618fdda9 tempest-VolumeDependencyTests-25904679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64" returned: 0 in 0.841s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3e5bc1af-9c63-4f15-b7d4-fed8618fdda9 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:34 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532 1G Jun 03 12:06:34 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:35 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3e5bc1af-9c63-4f15-b7d4-fed8618fdda9 tempest-VolumeDependencyTests-25904679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532 1G" returned: 0 in 0.863s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3e5bc1af-9c63-4f15-b7d4-fed8618fdda9 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:35 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532 Jun 03 12:06:35 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:36 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3e5bc1af-9c63-4f15-b7d4-fed8618fdda9 tempest-VolumeDependencyTests-25904679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532" returned: 0 in 0.710s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:36 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-3e5bc1af-9c63-4f15-b7d4-fed8618fdda9 tempest-VolumeDependencyTests-25904679 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532 is being set with open permissions: ugo+rw Jun 03 12:06:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3e5bc1af-9c63-4f15-b7d4-fed8618fdda9 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:36 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532 Jun 03 12:06:36 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 12:06:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:06:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:06:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:37 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3e5bc1af-9c63-4f15-b7d4-fed8618fdda9 tempest-VolumeDependencyTests-25904679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532" returned: 0 in 0.847s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:37 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:06:37 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3e5bc1af-9c63-4f15-b7d4-fed8618fdda9 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:37 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.info Jun 03 12:06:37 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:37 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.915s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:37 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:06:37 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3e5bc1af-9c63-4f15-b7d4-fed8618fdda9 tempest-VolumeDependencyTests-25904679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.info" returned: 0 in 0.775s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:37 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-3e5bc1af-9c63-4f15-b7d4-fed8618fdda9 tempest-VolumeDependencyTests-25904679 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.info is being set with open permissions: ugo+rw Jun 03 12:06:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3e5bc1af-9c63-4f15-b7d4-fed8618fdda9 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:37 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.info Jun 03 12:06:37 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:38 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3e5bc1af-9c63-4f15-b7d4-fed8618fdda9 tempest-VolumeDependencyTests-25904679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.info" returned: 0 in 0.668s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3e5bc1af-9c63-4f15-b7d4-fed8618fdda9 tempest-VolumeDependencyTests-25904679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.874s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:38 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-3e5bc1af-9c63-4f15-b7d4-fed8618fdda9 tempest-VolumeDependencyTests-25904679 None] Create snapshot completed successfully Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c2c50e8c-8c6b-4eb9-b07e-05982a898436 tempest-TestStampPattern-576404759 None] Acquiring lock "cinder-91aa4734-d9fa-4481-9f6a-7288e0632c67-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c2c50e8c-8c6b-4eb9-b07e-05982a898436 tempest-TestStampPattern-576404759 None] Lock "cinder-91aa4734-d9fa-4481-9f6a-7288e0632c67-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c2c50e8c-8c6b-4eb9-b07e-05982a898436 tempest-TestStampPattern-576404759 None] Acquiring lock "cinder-quobyte-91aa4734-d9fa-4481-9f6a-7288e0632c67" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c2c50e8c-8c6b-4eb9-b07e-05982a898436 tempest-TestStampPattern-576404759 None] Lock "cinder-quobyte-91aa4734-d9fa-4481-9f6a-7288e0632c67" acquired by "delete_volume" :: waited 0.015s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08605d9-e753-4b38-a528-c7f9d9cd7224]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c2c50e8c-8c6b-4eb9-b07e-05982a898436 tempest-TestStampPattern-576404759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-91aa4734-d9fa-4481-9f6a-7288e0632c67 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:39 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-91aa4734-d9fa-4481-9f6a-7288e0632c67 Jun 03 12:06:39 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Flow 'volume_create_manager' (01c02da4-431a-4adf-8372-6824b2727887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109de727-cc0b-420b-b733-f47b4d3ffb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109de727-cc0b-420b-b733-f47b4d3ffb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1923864328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b5d8db9-86fa-4ed3-869c-51b9b0a7f688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b9cd96c2e8d4cc59e5ae63f0b5d9f69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cb722857-a318-48a7-8b7a-aab524e35532,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:06:40Z,use_quota=True,user_id='81063b79b8f343dcae1b14626ec9355f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296d6b08-288a-4392-bc07-a79352e758b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296d6b08-288a-4392-bc07-a79352e758b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5815dff-5fc5-4ed3-b46a-9a65b364ce5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5815dff-5fc5-4ed3-b46a-9a65b364ce5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7b5d8db9-86fa-4ed3-869c-51b9b0a7f688', 'volume_name': 'volume-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688', 'volume_size': 1, 'snapshot_id': 'cb722857-a318-48a7-8b7a-aab524e35532'}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2df4baa-fed5-4de2-8e33-bf437ad80131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2df4baa-fed5-4de2-8e33-bf437ad80131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec2b55f-ea8c-4671-9cfa-d421443f457f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:06:39 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Volume 7b5d8db9-86fa-4ed3-869c-51b9b0a7f688: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688', 'volume_size': 1, 'snapshot_id': 'cb722857-a318-48a7-8b7a-aab524e35532'} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Acquiring lock "cinder-quobyte-cb722857-a318-48a7-8b7a-aab524e35532-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688" by "_create_volume_from_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Lock "cinder-quobyte-cb722857-a318-48a7-8b7a-aab524e35532-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Creating volume 7b5d8db9-86fa-4ed3-869c-51b9b0a7f688 from snapshot cb722857-a318-48a7-8b7a-aab524e35532 {{(pid=86724) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Acquiring lock "cinder-quobyte-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688" by "_copy_volume_from_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Lock "cinder-quobyte-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] snapshot: cb722857-a318-48a7-8b7a-aab524e35532, volume: 7b5d8db9-86fa-4ed3-869c-51b9b0a7f688, {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[399764a0-4361-4b48-af26-3a3f1eb293e6]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:39 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c2c50e8c-8c6b-4eb9-b07e-05982a898436 tempest-TestStampPattern-576404759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-91aa4734-d9fa-4481-9f6a-7288e0632c67" returned: 0 in 0.832s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c2c50e8c-8c6b-4eb9-b07e-05982a898436 tempest-TestStampPattern-576404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-91aa4734-d9fa-4481-9f6a-7288e0632c67 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:40 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532 Jun 03 12:06:40 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:40 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-91aa4734-d9fa-4481-9f6a-7288e0632c67 Jun 03 12:06:40 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:40 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c2c50e8c-8c6b-4eb9-b07e-05982a898436 tempest-TestStampPattern-576404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-91aa4734-d9fa-4481-9f6a-7288e0632c67" returned: 0 in 0.687s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:40 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532" returned: 0 in 0.800s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:06:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] will copy from snapshot at /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 12:06:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Creating direct copy from snapshot {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 12:06:40 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c2c50e8c-8c6b-4eb9-b07e-05982a898436 tempest-TestStampPattern-576404759 None] Lock "cinder-quobyte-91aa4734-d9fa-4481-9f6a-7288e0632c67" released by "delete_volume" :: held 1.574s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:40 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b211f7-3bc4-4485-a4ad-dac60980649e]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:06:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:40 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-c2c50e8c-8c6b-4eb9-b07e-05982a898436 tempest-TestStampPattern-576404759 None] Created reservations ['3c2e5216-76d9-4afc-84b0-b3a91f925b89', '94c67d31-35ee-4cda-9b03-fd3bb4871976', '8cf3d155-d3d4-44f8-b3d9-70ca02fb390a', 'd9c05926-d853-4638-9ad9-4db6b2f29821'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:06:40 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 Jun 03 12:06:40 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c2c50e8c-8c6b-4eb9-b07e-05982a898436 tempest-TestStampPattern-576404759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c2c50e8c-8c6b-4eb9-b07e-05982a898436 tempest-TestStampPattern-576404759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c2c50e8c-8c6b-4eb9-b07e-05982a898436 tempest-TestStampPattern-576404759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:06:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c2c50e8c-8c6b-4eb9-b07e-05982a898436 tempest-TestStampPattern-576404759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:06:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c2c50e8c-8c6b-4eb9-b07e-05982a898436 tempest-TestStampPattern-576404759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c2c50e8c-8c6b-4eb9-b07e-05982a898436 tempest-TestStampPattern-576404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:40 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:06:40 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:41 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:41 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c2c50e8c-8c6b-4eb9-b07e-05982a898436 tempest-TestStampPattern-576404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.658s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:41 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-c2c50e8c-8c6b-4eb9-b07e-05982a898436 tempest-TestStampPattern-576404759 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:06:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64" returned: 0 in 0.820s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:41 devstack cinder-volume[86724]: DEBUG cinder.utils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Path /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688 not found in is_blk_device check {{(pid=86724) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 03 12:06:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:41 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c2c50e8c-8c6b-4eb9-b07e-05982a898436 tempest-TestStampPattern-576404759 None] Deleted volume successfully. Jun 03 12:06:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c2c50e8c-8c6b-4eb9-b07e-05982a898436 tempest-TestStampPattern-576404759 None] Lock "cinder-91aa4734-d9fa-4481-9f6a-7288e0632c67-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:41 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688 Jun 03 12:06:41 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] Acquiring lock "cinder-8feef30d-75e9-41fd-91fb-3c9e16d918d9-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] Lock "cinder-8feef30d-75e9-41fd-91fb-3c9e16d918d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] Acquiring lock "cinder-quobyte-8ea71870-0942-46ae-a0e0-7ad16892a113" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] Lock "cinder-quobyte-8ea71870-0942-46ae-a0e0-7ad16892a113" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] Acquiring lock "cinder-quobyte-8feef30d-75e9-41fd-91fb-3c9e16d918d9" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] Lock "cinder-quobyte-8feef30d-75e9-41fd-91fb-3c9e16d918d9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:41 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] Deleting offline snapshot 8feef30d-75e9-41fd-91fb-3c9e16d918d9 of volume 8ea71870-0942-46ae-a0e0-7ad16892a113 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 12:06:41 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] snapshot_file for this snap is: volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 12:06:41 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e127683c-60a7-47c4-ad39-45ba0f5fcfe6]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:06:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:41 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9 Jun 03 12:06:41 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:43 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9" returned: 0 in 1.251s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ea71870-0942-46ae-a0e0-7ad16892a113(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:06:43 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2adaeaf-66df-4653-8cb0-404652f1440d]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:06:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:43 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 Jun 03 12:06:43 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:45 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113" returned: 0 in 2.086s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:45 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9 Jun 03 12:06:45 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:46 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9" returned: 0 in 1.677s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:47 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9 Jun 03 12:06:47 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688" returned: 0 in 5.784s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:47 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81299f4-1f5e-472c-909b-d26e52425749]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:06:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:47 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 Jun 03 12:06:47 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:47 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113.8feef30d-75e9-41fd-91fb-3c9e16d918d9" returned: 0 in 0.867s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:47 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:UPDATE=94,cinder:SELECT=80,cinder:INSERT=23,cinder:DELETE=10 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:06:47 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=75,cinder:UPDATE=108,cinder:DELETE=9,cinder:INSERT=21 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:06:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] Lock "cinder-quobyte-8feef30d-75e9-41fd-91fb-3c9e16d918d9" released by "_delete_snapshot" :: held 6.078s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] Lock "cinder-quobyte-8ea71870-0942-46ae-a0e0-7ad16892a113" released by "delete_snapshot" :: held 6.118s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:47 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] Created reservations ['b8a17b59-c7a5-4a54-8f52-e356e4abc4dd', 'acef37d5-361f-402b-ba78-19543a26858e', '045fedbc-f6d5-4253-a69f-359569ef1153', '0c6461fd-03fd-46a6-a603-5c13b5613707'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:06:47 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] Delete snapshot completed successfully. Jun 03 12:06:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fc9e1d11-a3ba-4de1-84e8-dc8c407c92aa tempest-TestStampPattern-576404759 None] Lock "cinder-8feef30d-75e9-41fd-91fb-3c9e16d918d9-delete_snapshot" released by "delete_snapshot" :: held 6.273s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-af838ea1-5fa8-4901-a969-66da78100190 tempest-VolumesNegativeTest-864037643 None] Acquiring lock "cinder-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-af838ea1-5fa8-4901-a969-66da78100190 tempest-VolumesNegativeTest-864037643 None] Lock "cinder-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-af838ea1-5fa8-4901-a969-66da78100190 tempest-VolumesNegativeTest-864037643 None] Acquiring lock "cinder-quobyte-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-af838ea1-5fa8-4901-a969-66da78100190 tempest-VolumesNegativeTest-864037643 None] Lock "cinder-quobyte-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35" acquired by "delete_volume" :: waited 0.018s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:48 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[340ca5c8-f42a-4bd8-bc12-f966693e9028]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:06:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-af838ea1-5fa8-4901-a969-66da78100190 tempest-VolumesNegativeTest-864037643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:48 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64" returned: 0 in 0.945s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:48 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Image conversion details: src /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688 {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 12:06:48 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Converted 1024.00 MB image at 176.99 MB/s Jun 03 12:06:48 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688 is being set with open permissions: ugo+rw Jun 03 12:06:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:48 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35 Jun 03 12:06:48 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:48 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688 Jun 03 12:06:48 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:48 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-af838ea1-5fa8-4901-a969-66da78100190 tempest-VolumesNegativeTest-864037643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35" returned: 0 in 0.773s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-af838ea1-5fa8-4901-a969-66da78100190 tempest-VolumesNegativeTest-864037643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:48 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:48 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35 Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688" returned: 0 in 0.714s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:49 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Lock "cinder-quobyte-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688" released by "_copy_volume_from_snapshot" :: held 9.210s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Lock "cinder-quobyte-cb722857-a318-48a7-8b7a-aab524e35532-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688" released by "_create_volume_from_snapshot" :: held 9.264s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.292s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec2b55f-ea8c-4671-9cfa-d421443f457f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688', 'volume_size': 1, 'snapshot_id': 'cb722857-a318-48a7-8b7a-aab524e35532'}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81869104-00f9-4939-a2b0-45b9d890234c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:06:49 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Volume volume-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688 (7b5d8db9-86fa-4ed3-869c-51b9b0a7f688): created successfully Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81869104-00f9-4939-a2b0-45b9d890234c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Flow 'volume_create_manager' (01c02da4-431a-4adf-8372-6824b2727887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:06:49 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-5a01b88a-6bde-4ef6-bc4e-97e68a604bf6 tempest-VolumeDependencyTests-25904679 None] Created volume successfully. Jun 03 12:06:49 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-af838ea1-5fa8-4901-a969-66da78100190 tempest-VolumesNegativeTest-864037643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35" returned: 0 in 0.703s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-af838ea1-5fa8-4901-a969-66da78100190 tempest-VolumesNegativeTest-864037643 None] Lock "cinder-quobyte-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35" released by "delete_volume" :: held 1.514s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] Acquiring lock "cinder-cb722857-a318-48a7-8b7a-aab524e35532-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] Lock "cinder-cb722857-a318-48a7-8b7a-aab524e35532-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] Acquiring lock "cinder-quobyte-d3300c21-96f5-4329-b50a-7b7a4f34cc64" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] Lock "cinder-quobyte-d3300c21-96f5-4329-b50a-7b7a4f34cc64" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] Acquiring lock "cinder-quobyte-cb722857-a318-48a7-8b7a-aab524e35532" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-af838ea1-5fa8-4901-a969-66da78100190 tempest-VolumesNegativeTest-864037643 None] Created reservations ['1b186b6c-918a-48c9-8d0d-0ce5ecb66a49', 'a49644f2-1bdf-4416-ae73-c5482ff7bfb1', '84a3d971-e9b1-45c4-a2e5-9868964f9fe7', '46f595d4-4252-4e18-a64d-bbba1aa112cb'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] Lock "cinder-quobyte-cb722857-a318-48a7-8b7a-aab524e35532" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] Deleting offline snapshot cb722857-a318-48a7-8b7a-aab524e35532 of volume d3300c21-96f5-4329-b50a-7b7a4f34cc64 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] snapshot_file for this snap is: volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[011b6eef-0612-4ada-9662-260f22c7b8ba]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-af838ea1-5fa8-4901-a969-66da78100190 tempest-VolumesNegativeTest-864037643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-af838ea1-5fa8-4901-a969-66da78100190 tempest-VolumesNegativeTest-864037643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-af838ea1-5fa8-4901-a969-66da78100190 tempest-VolumesNegativeTest-864037643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-af838ea1-5fa8-4901-a969-66da78100190 tempest-VolumesNegativeTest-864037643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-af838ea1-5fa8-4901-a969-66da78100190 tempest-VolumesNegativeTest-864037643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-af838ea1-5fa8-4901-a969-66da78100190 tempest-VolumesNegativeTest-864037643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:49 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:06:49 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:49 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532 Jun 03 12:06:49 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:50 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-af838ea1-5fa8-4901-a969-66da78100190 tempest-VolumesNegativeTest-864037643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.043s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:50 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-af838ea1-5fa8-4901-a969-66da78100190 tempest-VolumesNegativeTest-864037643 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:06:50 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-af838ea1-5fa8-4901-a969-66da78100190 tempest-VolumesNegativeTest-864037643 None] Deleted volume successfully. Jun 03 12:06:51 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-af838ea1-5fa8-4901-a969-66da78100190 tempest-VolumesNegativeTest-864037643 None] Lock "cinder-cf6c7ea3-bc59-4cc5-a225-4168cf7c6f35-delete_volume" released by "delete_volume" :: held 2.910s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:51 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532" returned: 0 in 1.249s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:06:51 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[295c90e0-a235-42d6-9dfa-c9920d61fa73]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:06:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:51 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 Jun 03 12:06:51 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:52 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64" returned: 0 in 1.044s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:52 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532 Jun 03 12:06:52 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:53 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532" returned: 0 in 1.058s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:53 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532 Jun 03 12:06:53 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:54 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64.cb722857-a318-48a7-8b7a-aab524e35532" returned: 0 in 0.752s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] Lock "cinder-quobyte-cb722857-a318-48a7-8b7a-aab524e35532" released by "_delete_snapshot" :: held 4.300s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] Lock "cinder-quobyte-d3300c21-96f5-4329-b50a-7b7a4f34cc64" released by "delete_snapshot" :: held 4.344s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:54 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] Created reservations ['fea9f738-50f4-42ba-bf2f-92a601927def', '8c791ce9-b3d0-4ad5-9b71-863dc517c790', '24bfeb8f-1585-41e4-93af-46ff81e85247', '44d929cc-15d6-4590-8920-b5c83878e0a7'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:06:54 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] Delete snapshot completed successfully. Jun 03 12:06:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-eb2ef803-0bf8-41f2-9401-0521c00e6fb0 tempest-VolumeDependencyTests-25904679 None] Lock "cinder-cb722857-a318-48a7-8b7a-aab524e35532-delete_snapshot" released by "delete_snapshot" :: held 4.559s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:55 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-55ab05ac-b87f-4643-b84b-4da37791ee49 tempest-VolumeDependencyTests-25904679 None] Acquiring lock "cinder-d3300c21-96f5-4329-b50a-7b7a4f34cc64-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:55 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-55ab05ac-b87f-4643-b84b-4da37791ee49 tempest-VolumeDependencyTests-25904679 None] Lock "cinder-d3300c21-96f5-4329-b50a-7b7a4f34cc64-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:55 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-55ab05ac-b87f-4643-b84b-4da37791ee49 tempest-VolumeDependencyTests-25904679 None] Acquiring lock "cinder-quobyte-d3300c21-96f5-4329-b50a-7b7a4f34cc64" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:55 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-55ab05ac-b87f-4643-b84b-4da37791ee49 tempest-VolumeDependencyTests-25904679 None] Lock "cinder-quobyte-d3300c21-96f5-4329-b50a-7b7a4f34cc64" acquired by "delete_volume" :: waited 0.021s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:55 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e1d3e4-e786-4641-8ad8-2e87ddd26800]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:06:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-55ab05ac-b87f-4643-b84b-4da37791ee49 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:55 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 Jun 03 12:06:55 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:55 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-d3b2c780-0a1a-45d2-acf7-c3a1f34aea65 tempest-TestShelveInstance-1271863328 None] Terminate volume connection completed successfully. Jun 03 12:06:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-d3b2c780-0a1a-45d2-acf7-c3a1f34aea65 tempest-TestShelveInstance-1271863328 None] Deleting attachment fe568b07-5c86-41ad-b261-55911e5eac94. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 12:06:56 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-55ab05ac-b87f-4643-b84b-4da37791ee49 tempest-VolumeDependencyTests-25904679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64" returned: 0 in 0.864s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-55ab05ac-b87f-4643-b84b-4da37791ee49 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2e0d50ff-5355-41a8-9af2-98a6bcdce0ee tempest-TestStampPattern-576404759 None] Acquiring lock "cinder-8ea71870-0942-46ae-a0e0-7ad16892a113-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:56 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64 Jun 03 12:06:56 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2e0d50ff-5355-41a8-9af2-98a6bcdce0ee tempest-TestStampPattern-576404759 None] Lock "cinder-8ea71870-0942-46ae-a0e0-7ad16892a113-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2e0d50ff-5355-41a8-9af2-98a6bcdce0ee tempest-TestStampPattern-576404759 None] Acquiring lock "cinder-quobyte-8ea71870-0942-46ae-a0e0-7ad16892a113" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2e0d50ff-5355-41a8-9af2-98a6bcdce0ee tempest-TestStampPattern-576404759 None] Lock "cinder-quobyte-8ea71870-0942-46ae-a0e0-7ad16892a113" acquired by "delete_volume" :: waited 0.022s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:56 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff7f377-d145-417c-84bf-1d7dcb52148f]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:06:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2e0d50ff-5355-41a8-9af2-98a6bcdce0ee tempest-TestStampPattern-576404759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:56 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 Jun 03 12:06:56 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] Acquiring lock "cinder-135f9f69-b862-408e-968f-21bc59fa6d96-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] Lock "cinder-135f9f69-b862-408e-968f-21bc59fa6d96-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] Acquiring lock "cinder-quobyte-135f9f69-b862-408e-968f-21bc59fa6d96" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] Lock "cinder-quobyte-135f9f69-b862-408e-968f-21bc59fa6d96" acquired by "delete_volume" :: waited 0.015s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:56 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[525fa3ef-0640-4eaf-a2ab-8f8a97ea7651]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:06:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:56 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-55ab05ac-b87f-4643-b84b-4da37791ee49 tempest-VolumeDependencyTests-25904679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3300c21-96f5-4329-b50a-7b7a4f34cc64" returned: 0 in 0.768s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-55ab05ac-b87f-4643-b84b-4da37791ee49 tempest-VolumeDependencyTests-25904679 None] Lock "cinder-quobyte-d3300c21-96f5-4329-b50a-7b7a4f34cc64" released by "delete_volume" :: held 1.722s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:56 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 Jun 03 12:06:56 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:56 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-55ab05ac-b87f-4643-b84b-4da37791ee49 tempest-VolumeDependencyTests-25904679 None] Created reservations ['41012a7b-44d1-47a7-8a4e-b7367100d3ef', 'beea5f8c-3318-4a0f-8ee9-3d8640b4805e', '2648beea-9bc5-4a58-a1d6-f7cc20cf76c1', 'fe1063a2-11b2-4ef6-83f8-cbba8ef70acd'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:06:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-55ab05ac-b87f-4643-b84b-4da37791ee49 tempest-VolumeDependencyTests-25904679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-55ab05ac-b87f-4643-b84b-4da37791ee49 tempest-VolumeDependencyTests-25904679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:57 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-55ab05ac-b87f-4643-b84b-4da37791ee49 tempest-VolumeDependencyTests-25904679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:06:57 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-55ab05ac-b87f-4643-b84b-4da37791ee49 tempest-VolumeDependencyTests-25904679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:06:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-55ab05ac-b87f-4643-b84b-4da37791ee49 tempest-VolumeDependencyTests-25904679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-55ab05ac-b87f-4643-b84b-4da37791ee49 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:57 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:06:57 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:57 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2e0d50ff-5355-41a8-9af2-98a6bcdce0ee tempest-TestStampPattern-576404759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113" returned: 0 in 1.120s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2e0d50ff-5355-41a8-9af2-98a6bcdce0ee tempest-TestStampPattern-576404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:57 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113 Jun 03 12:06:57 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:57 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-98220d4f-1047-4154-9f04-8bf3a205f250 tempest-VolumeDependencyTests-25904679 None] Acquiring lock "cinder-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:57 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-98220d4f-1047-4154-9f04-8bf3a205f250 tempest-VolumeDependencyTests-25904679 None] Lock "cinder-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:57 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-98220d4f-1047-4154-9f04-8bf3a205f250 tempest-VolumeDependencyTests-25904679 None] Acquiring lock "cinder-quobyte-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:06:57 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-98220d4f-1047-4154-9f04-8bf3a205f250 tempest-VolumeDependencyTests-25904679 None] Lock "cinder-quobyte-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688" acquired by "delete_volume" :: waited 0.022s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:06:57 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d02224d-d35e-4ea3-91c4-a6a66a44ffd5]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:06:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98220d4f-1047-4154-9f04-8bf3a205f250 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:57 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96" returned: 0 in 1.087s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:57 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688 Jun 03 12:06:57 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:58 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 Jun 03 12:06:58 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:58 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-55ab05ac-b87f-4643-b84b-4da37791ee49 tempest-VolumeDependencyTests-25904679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.150s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:58 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-55ab05ac-b87f-4643-b84b-4da37791ee49 tempest-VolumeDependencyTests-25904679 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:06:58 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-55ab05ac-b87f-4643-b84b-4da37791ee49 tempest-VolumeDependencyTests-25904679 None] Deleted volume successfully. Jun 03 12:06:58 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-55ab05ac-b87f-4643-b84b-4da37791ee49 tempest-VolumeDependencyTests-25904679 None] Lock "cinder-d3300c21-96f5-4329-b50a-7b7a4f34cc64-delete_volume" released by "delete_volume" :: held 3.174s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:58 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2e0d50ff-5355-41a8-9af2-98a6bcdce0ee tempest-TestStampPattern-576404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-8ea71870-0942-46ae-a0e0-7ad16892a113" returned: 0 in 1.097s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:58 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2e0d50ff-5355-41a8-9af2-98a6bcdce0ee tempest-TestStampPattern-576404759 None] Lock "cinder-quobyte-8ea71870-0942-46ae-a0e0-7ad16892a113" released by "delete_volume" :: held 2.317s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:58 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-2e0d50ff-5355-41a8-9af2-98a6bcdce0ee tempest-TestStampPattern-576404759 None] Created reservations ['aab18d48-228a-463a-a5c2-ff49a5250330', '65322d63-ca35-4fe0-ae8f-ccdaba562d2e', 'f2d68054-0086-44bb-b03b-a834eef6abb2', 'bd730581-4b55-4b33-9196-35c1491be92f'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:06:58 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98220d4f-1047-4154-9f04-8bf3a205f250 tempest-VolumeDependencyTests-25904679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688" returned: 0 in 1.032s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98220d4f-1047-4154-9f04-8bf3a205f250 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:58 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688 Jun 03 12:06:58 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2e0d50ff-5355-41a8-9af2-98a6bcdce0ee tempest-TestStampPattern-576404759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2e0d50ff-5355-41a8-9af2-98a6bcdce0ee tempest-TestStampPattern-576404759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:58 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2e0d50ff-5355-41a8-9af2-98a6bcdce0ee tempest-TestStampPattern-576404759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:06:58 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2e0d50ff-5355-41a8-9af2-98a6bcdce0ee tempest-TestStampPattern-576404759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:06:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2e0d50ff-5355-41a8-9af2-98a6bcdce0ee tempest-TestStampPattern-576404759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2e0d50ff-5355-41a8-9af2-98a6bcdce0ee tempest-TestStampPattern-576404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:58 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:06:58 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:59 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96" returned: 1 in 1.233s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:06:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:59 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96 Jun 03 12:06:59 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:59 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98220d4f-1047-4154-9f04-8bf3a205f250 tempest-VolumeDependencyTests-25904679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688" returned: 0 in 0.876s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-98220d4f-1047-4154-9f04-8bf3a205f250 tempest-VolumeDependencyTests-25904679 None] Lock "cinder-quobyte-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688" released by "delete_volume" :: held 1.982s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:59 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-98220d4f-1047-4154-9f04-8bf3a205f250 tempest-VolumeDependencyTests-25904679 None] Created reservations ['eceb0f66-c83d-4c9f-a3ca-1044de3b5353', 'bd1440f3-20af-4877-9335-5a435b58f987', '392e802d-417b-443c-965b-fc666b0c7afe', '33881175-6ed4-4e10-b2f3-9483c58682ad'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:06:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-98220d4f-1047-4154-9f04-8bf3a205f250 tempest-VolumeDependencyTests-25904679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:06:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-98220d4f-1047-4154-9f04-8bf3a205f250 tempest-VolumeDependencyTests-25904679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:06:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-98220d4f-1047-4154-9f04-8bf3a205f250 tempest-VolumeDependencyTests-25904679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:06:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-98220d4f-1047-4154-9f04-8bf3a205f250 tempest-VolumeDependencyTests-25904679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:06:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-98220d4f-1047-4154-9f04-8bf3a205f250 tempest-VolumeDependencyTests-25904679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:06:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98220d4f-1047-4154-9f04-8bf3a205f250 tempest-VolumeDependencyTests-25904679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:06:59 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:06:59 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:06:59 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-135f9f69-b862-408e-968f-21bc59fa6d96" returned: 0 in 0.859s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] Lock "cinder-quobyte-135f9f69-b862-408e-968f-21bc59fa6d96" released by "delete_volume" :: held 3.312s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:06:59 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Jun 03 12:06:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2e0d50ff-5355-41a8-9af2-98a6bcdce0ee tempest-TestStampPattern-576404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.252s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:06:59 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-2e0d50ff-5355-41a8-9af2-98a6bcdce0ee tempest-TestStampPattern-576404759 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:06:59 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-2e0d50ff-5355-41a8-9af2-98a6bcdce0ee tempest-TestStampPattern-576404759 None] Deleted volume successfully. Jun 03 12:07:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2e0d50ff-5355-41a8-9af2-98a6bcdce0ee tempest-TestStampPattern-576404759 None] Lock "cinder-8ea71870-0942-46ae-a0e0-7ad16892a113-delete_volume" released by "delete_volume" :: held 3.896s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:00 devstack cinder-volume[86724]: DEBUG cinder.quota [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] Created reservations ['24c1ddde-4d93-4f0b-99a6-5734cf74d270', '885e1b7d-e391-4842-8122-c6118a2d996e', '0bfd2b09-b7e5-48c9-97b0-daf4c33da7ba', '85ec3912-5b72-458d-bd3d-e86f49d07a72'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:07:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:00 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:07:00 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:00 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98220d4f-1047-4154-9f04-8bf3a205f250 tempest-VolumeDependencyTests-25904679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.010s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:00 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-98220d4f-1047-4154-9f04-8bf3a205f250 tempest-VolumeDependencyTests-25904679 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:07:00 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-98220d4f-1047-4154-9f04-8bf3a205f250 tempest-VolumeDependencyTests-25904679 None] Deleted volume successfully. Jun 03 12:07:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-98220d4f-1047-4154-9f04-8bf3a205f250 tempest-VolumeDependencyTests-25904679 None] Lock "cinder-7b5d8db9-86fa-4ed3-869c-51b9b0a7f688-delete_volume" released by "delete_volume" :: held 3.446s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:00 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.849s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:01 devstack cinder-volume[86724]: DEBUG cinder.manager [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:07:01 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] Deleted volume successfully. Jun 03 12:07:01 devstack cinder-volume[86724]: DEBUG cinder.coordination [req-fa16ae19-69f8-43fa-85de-4dfab78cb13a req-e843fdc0-a224-4d68-93f9-4865c43f6383 tempest-TestShelveInstance-1271863328 None] Lock "cinder-135f9f69-b862-408e-968f-21bc59fa6d96-delete_volume" released by "delete_volume" :: held 4.460s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Flow 'volume_create_manager' (89185449-5d0f-4c4f-878a-83778c67954a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa98a1df-e85a-44a9-96d6-2116529f5ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa98a1df-e85a-44a9-96d6-2116529f5ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-460672001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d7544d-3e1a-485b-9f31-ae2f5f4cc673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c3129e0c0b4264aa94af3e6181eff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:07Z,use_quota=True,user_id='69cbc18134214d10a7785e1dda1a6eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71493fea-3dc8-439c-b101-3636cadaeb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71493fea-3dc8-439c-b101-3636cadaeb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db00e87d-2473-4098-a85f-8018d7ee80bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db00e87d-2473-4098-a85f-8018d7ee80bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d7544d-3e1a-485b-9f31-ae2f5f4cc673', 'volume_name': 'volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f25093-1dfa-4f90-bd64-b33714ebcaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f25093-1dfa-4f90-bd64-b33714ebcaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae5bc2b-7c52-4a54-8736-d5989139114d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:07 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Volume 75d7544d-3e1a-485b-9f31-ae2f5f4cc673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673', 'volume_size': 1} Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-460672001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d7544d-3e1a-485b-9f31-ae2f5f4cc673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c3129e0c0b4264aa94af3e6181eff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:07Z,use_quota=True,user_id='69cbc18134214d10a7785e1dda1a6eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Creating volume 75d7544d-3e1a-485b-9f31-ae2f5f4cc673 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:07:07 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:07:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:07 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673 1073741824 Jun 03 12:07:07 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:08 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673 1073741824" returned: 0 in 1.136s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:08 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673 Jun 03 12:07:08 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:09 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673" returned: 0 in 0.787s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] <== create_volume: return (1978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:07:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae5bc2b-7c52-4a54-8736-d5989139114d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685f6e66-bea3-4d57-b389-15edec5af460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:09 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Volume volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673 (75d7544d-3e1a-485b-9f31-ae2f5f4cc673): created successfully Jun 03 12:07:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685f6e66-bea3-4d57-b389-15edec5af460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Flow 'volume_create_manager' (89185449-5d0f-4c4f-878a-83778c67954a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:09 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-7cac99a6-92cc-4005-aa00-cd4679e4aea0 tempest-VolumesSnapshotTestJSON-1501817216 None] Created volume successfully. Jun 03 12:07:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-349cfc40-3b2b-4249-81fd-eaf3014bbcc2 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-349cfc40-3b2b-4249-81fd-eaf3014bbcc2 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-349cfc40-3b2b-4249-81fd-eaf3014bbcc2 tempest-VolumesSnapshotTestJSON-1501817216 None] Creating offline snapshot 565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8 of volume 75d7544d-3e1a-485b-9f31-ae2f5f4cc673 {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 12:07:10 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea97c467-0c0d-4983-88ab-4ec0d133a91b]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-349cfc40-3b2b-4249-81fd-eaf3014bbcc2 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:10 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673 Jun 03 12:07:10 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:11 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-349cfc40-3b2b-4249-81fd-eaf3014bbcc2 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673" returned: 0 in 0.770s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-349cfc40-3b2b-4249-81fd-eaf3014bbcc2 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:11 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8 1G Jun 03 12:07:11 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:12 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-349cfc40-3b2b-4249-81fd-eaf3014bbcc2 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8 1G" returned: 0 in 1.038s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-349cfc40-3b2b-4249-81fd-eaf3014bbcc2 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:12 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8 Jun 03 12:07:12 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:13 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-349cfc40-3b2b-4249-81fd-eaf3014bbcc2 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8" returned: 0 in 0.832s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:13 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-349cfc40-3b2b-4249-81fd-eaf3014bbcc2 tempest-VolumesSnapshotTestJSON-1501817216 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8 is being set with open permissions: ugo+rw Jun 03 12:07:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-349cfc40-3b2b-4249-81fd-eaf3014bbcc2 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:13 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8 Jun 03 12:07:13 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:14 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-349cfc40-3b2b-4249-81fd-eaf3014bbcc2 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8" returned: 0 in 0.719s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-349cfc40-3b2b-4249-81fd-eaf3014bbcc2 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:14 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.info Jun 03 12:07:14 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:14 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-349cfc40-3b2b-4249-81fd-eaf3014bbcc2 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.info" returned: 0 in 0.727s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:14 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-349cfc40-3b2b-4249-81fd-eaf3014bbcc2 tempest-VolumesSnapshotTestJSON-1501817216 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.info is being set with open permissions: ugo+rw Jun 03 12:07:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-349cfc40-3b2b-4249-81fd-eaf3014bbcc2 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:14 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.info Jun 03 12:07:14 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:15 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-349cfc40-3b2b-4249-81fd-eaf3014bbcc2 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.info" returned: 0 in 0.710s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-349cfc40-3b2b-4249-81fd-eaf3014bbcc2 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.913s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:15 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-349cfc40-3b2b-4249-81fd-eaf3014bbcc2 tempest-VolumesSnapshotTestJSON-1501817216 None] Create snapshot completed successfully Jun 03 12:07:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-quobyte-75d7544d-3e1a-485b-9f31-ae2f5f4cc673" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-75d7544d-3e1a-485b-9f31-ae2f5f4cc673" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-quobyte-565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:16 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:16 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] Deleting offline snapshot 565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8 of volume 75d7544d-3e1a-485b-9f31-ae2f5f4cc673 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 12:07:16 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] snapshot_file for this snap is: volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 12:07:16 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[140f08ea-8a5b-43a8-bfd0-f32ebdd7f002]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:16 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8 Jun 03 12:07:16 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:17 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8" returned: 0 in 0.785s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[164fde24-c366-4a4e-acc5-fb86b61b3ac7]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:17 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673 Jun 03 12:07:17 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Flow 'volume_create_manager' (48973ae9-abb4-41a4-9701-e4da291a0a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a449889-db66-48e1-95ed-ffd88a352ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a449889-db66-48e1-95ed-ffd88a352ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1444752701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9aefd2-209a-4db2-81c9-dc62b75a672e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd5ef757d024d1f965877ae37795f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:18Z,use_quota=True,user_id='8f4a8419d7914a8488e2de67ffff08de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3591778-2d47-45e6-9bd7-53a4b477e174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3591778-2d47-45e6-9bd7-53a4b477e174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa6f252-76be-4a28-86be-fc7b65dd9bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa6f252-76be-4a28-86be-fc7b65dd9bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a9aefd2-209a-4db2-81c9-dc62b75a672e', 'volume_name': 'volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b4961d-4827-4104-8254-78cda33d3e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b4961d-4827-4104-8254-78cda33d3e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7315c97e-a658-41a0-a700-f5ccb5b56277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:17 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Volume 6a9aefd2-209a-4db2-81c9-dc62b75a672e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e', 'volume_size': 1} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1444752701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9aefd2-209a-4db2-81c9-dc62b75a672e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd5ef757d024d1f965877ae37795f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:18Z,use_quota=True,user_id='8f4a8419d7914a8488e2de67ffff08de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Creating volume 6a9aefd2-209a-4db2-81c9-dc62b75a672e {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:07:17 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:17 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e 1073741824 Jun 03 12:07:17 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:17 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673" returned: 0 in 0.811s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:17 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8 Jun 03 12:07:17 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:18 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e 1073741824" returned: 0 in 0.852s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:18 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e Jun 03 12:07:18 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:18 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8" returned: 0 in 0.823s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:18 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8 Jun 03 12:07:18 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:19 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e" returned: 0 in 0.666s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:07:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:19 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7315c97e-a658-41a0-a700-f5ccb5b56277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:19 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e2f0d7-d413-428b-ac00-a8c3e3bccd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:19 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Volume volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e (6a9aefd2-209a-4db2-81c9-dc62b75a672e): created successfully Jun 03 12:07:19 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e2f0d7-d413-428b-ac00-a8c3e3bccd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:19 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Flow 'volume_create_manager' (48973ae9-abb4-41a4-9701-e4da291a0a70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:19 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c0fe792a-4be2-405a-8737-f000b470d54f tempest-CreateVolumesFromSnapshotTest-546590517 None] Created volume successfully. Jun 03 12:07:19 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673.565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8" returned: 0 in 0.675s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:19 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8" released by "_delete_snapshot" :: held 3.206s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:19 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-75d7544d-3e1a-485b-9f31-ae2f5f4cc673" released by "delete_snapshot" :: held 3.227s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:19 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] Created reservations ['b6152515-052c-4120-8e2c-928c9d7d86df', 'a678a52e-daa7-40da-9571-d28e60f8d1e5', 'fb12795d-71a0-482d-9283-bf8eadfa6b9e', '0ac6a60e-bdb0-4b5e-87a5-24101b5f92f2'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:07:19 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] Delete snapshot completed successfully. Jun 03 12:07:19 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-fae7d35b-6297-4699-a32c-2fd8e39897cd tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-565d3ddb-59ef-4ed4-aef0-27d40ff4d8c8-delete_snapshot" released by "delete_snapshot" :: held 3.406s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-96b09e01-1416-484d-be6d-afdc497d4075 tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-96b09e01-1416-484d-be6d-afdc497d4075 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-96b09e01-1416-484d-be6d-afdc497d4075 tempest-CreateVolumesFromSnapshotTest-546590517 None] Creating offline snapshot 7702fa9e-67a6-4e1d-8713-4287f785fcb1 of volume 6a9aefd2-209a-4db2-81c9-dc62b75a672e {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 12:07:19 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[306ea826-04d1-4013-a5d5-2c752fd594b5]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-96b09e01-1416-484d-be6d-afdc497d4075 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:20 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e Jun 03 12:07:20 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:20 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:07:20 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Flow 'volume_create_manager' (0ef4f68f-f7bc-4e43-997b-d03421c4583c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:20 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1c7b90-9bf5-42ec-a03d-02daca5788f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:20 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1c7b90-9bf5-42ec-a03d-02daca5788f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d2f47ed-776b-4479-b1af-09b65e961da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe37d81afd074cfcba8ed3c7f7290d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:20Z,use_quota=True,user_id='73cefe72789b42eaad8e7c8bded0a608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c38dcf29-d5e0-44de-985b-8391f208322c),volume_type_id=c38dcf29-d5e0-44de-985b-8391f208322c)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:20 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb03ebbc-74be-4001-9da1-fdfd6312cbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:20 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb03ebbc-74be-4001-9da1-fdfd6312cbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:20 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26437c83-4c08-413e-aae8-2ddda2a35783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:20 devstack cinder-volume[86724]: DEBUG cinder.image.glance [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Creating Keystone auth plugin from conf {{(pid=86724) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 03 12:07:20 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26437c83-4c08-413e-aae8-2ddda2a35783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4d2f47ed-776b-4479-b1af-09b65e961da2', 'volume_name': 'volume-4d2f47ed-776b-4479-b1af-09b65e961da2', 'volume_size': 1, 'image_id': 'c817a8fc-f071-4060-a67c-941e49dd2b38', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c817a8fc-f071-4060-a67c-941e49dd2b38', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8b2b704f99c7eb58528d8092102954b9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fe37d81afd074cfcba8ed3c7f7290d45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a8ce0b5e61c91fac0dd32ed348834829dfbc1d634813107a0a4243cf33b79e4ef0558a8d492b3f68bb2a65b5c76de9c805b2fd434275f0555363c3c83f27c156', 'id': 'c817a8fc-f071-4060-a67c-941e49dd2b38', 'created_at': datetime.datetime(2026, 6, 3, 10, 7, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 10, 7, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c817a8fc-f071-4060-a67c-941e49dd2b38/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:20 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6dcb7d6-ac5c-4deb-a6f6-ed2cf0b82872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:20 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6dcb7d6-ac5c-4deb-a6f6-ed2cf0b82872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:20 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3669e04-4292-4b63-bd38-6455c10f9559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:20 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Volume 4d2f47ed-776b-4479-b1af-09b65e961da2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4d2f47ed-776b-4479-b1af-09b65e961da2', 'volume_size': 1, 'image_id': 'c817a8fc-f071-4060-a67c-941e49dd2b38', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c817a8fc-f071-4060-a67c-941e49dd2b38', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8b2b704f99c7eb58528d8092102954b9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fe37d81afd074cfcba8ed3c7f7290d45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a8ce0b5e61c91fac0dd32ed348834829dfbc1d634813107a0a4243cf33b79e4ef0558a8d492b3f68bb2a65b5c76de9c805b2fd434275f0555363c3c83f27c156', 'id': 'c817a8fc-f071-4060-a67c-941e49dd2b38', 'created_at': datetime.datetime(2026, 6, 3, 10, 7, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 10, 7, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c817a8fc-f071-4060-a67c-941e49dd2b38/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 03 12:07:20 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Trying to clone 4d2f47ed-776b-4479-b1af-09b65e961da2 from image c817a8fc-f071-4060-a67c-941e49dd2b38 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c817a8fc-f071-4060-a67c-941e49dd2b38', 'metadata': {}}]). {{(pid=86724) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 03 12:07:20 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-96b09e01-1416-484d-be6d-afdc497d4075 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e" returned: 0 in 0.793s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-96b09e01-1416-484d-be6d-afdc497d4075 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.7702fa9e-67a6-4e1d-8713-4287f785fcb1 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:20 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.7702fa9e-67a6-4e1d-8713-4287f785fcb1 1G Jun 03 12:07:20 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 03 12:07:20 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Image download 0.00 MB at 0.00 MB/s Jun 03 12:07:20 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:20 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac80a3c-7015-434f-ab08-da24bae780f3]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:20 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:07:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Flow 'volume_create_manager' (67de8e42-fcf0-4cda-967f-d0806f39bb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4081f79-07b4-4b74-9cb4-4f04f8dacec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:21 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD Jun 03 12:07:21 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4081f79-07b4-4b74-9cb4-4f04f8dacec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1372373438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50a8d17-b065-4fee-a93e-9acbffa6c981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c3129e0c0b4264aa94af3e6181eff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:21Z,use_quota=True,user_id='69cbc18134214d10a7785e1dda1a6eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1e5088-ec4d-45f3-8823-6187247463f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1e5088-ec4d-45f3-8823-6187247463f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843165aa-0135-4d38-adf8-68a246a59700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843165aa-0135-4d38-adf8-68a246a59700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f50a8d17-b065-4fee-a93e-9acbffa6c981', 'volume_name': 'volume-f50a8d17-b065-4fee-a93e-9acbffa6c981', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc67a2f-aa48-4fb8-aea0-83afea0fdbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc67a2f-aa48-4fb8-aea0-83afea0fdbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:21 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce364eb-c7e2-4753-ba72-70f0154b048b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:21 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Volume f50a8d17-b065-4fee-a93e-9acbffa6c981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f50a8d17-b065-4fee-a93e-9acbffa6c981', 'volume_size': 1} Jun 03 12:07:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:21 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-96b09e01-1416-484d-be6d-afdc497d4075 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.7702fa9e-67a6-4e1d-8713-4287f785fcb1 1G" returned: 0 in 0.811s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-96b09e01-1416-484d-be6d-afdc497d4075 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.7702fa9e-67a6-4e1d-8713-4287f785fcb1 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:21 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.7702fa9e-67a6-4e1d-8713-4287f785fcb1 Jun 03 12:07:21 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:21 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD" returned: 0 in 0.776s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:21 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD Jun 03 12:07:21 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:22 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-96b09e01-1416-484d-be6d-afdc497d4075 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.7702fa9e-67a6-4e1d-8713-4287f785fcb1" returned: 0 in 0.663s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:22 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-96b09e01-1416-484d-be6d-afdc497d4075 tempest-CreateVolumesFromSnapshotTest-546590517 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.7702fa9e-67a6-4e1d-8713-4287f785fcb1 is being set with open permissions: ugo+rw Jun 03 12:07:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-96b09e01-1416-484d-be6d-afdc497d4075 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.7702fa9e-67a6-4e1d-8713-4287f785fcb1 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:22 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.7702fa9e-67a6-4e1d-8713-4287f785fcb1 Jun 03 12:07:22 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:22 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD" returned: 1 in 0.683s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:07:22 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Temporary image c817a8fc-f071-4060-a67c-941e49dd2b38 is fetched for user 73cefe72789b42eaad8e7c8bded0a608. {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 03 12:07:22 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[45eb8f34-ead2-4522-9c6e-edcafc9f07ff]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:22 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD Jun 03 12:07:22 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:22 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-96b09e01-1416-484d-be6d-afdc497d4075 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.7702fa9e-67a6-4e1d-8713-4287f785fcb1" returned: 0 in 0.600s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-96b09e01-1416-484d-be6d-afdc497d4075 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:22 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.info Jun 03 12:07:22 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:23 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD" returned: 0 in 0.705s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:23 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD Jun 03 12:07:23 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:23 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-96b09e01-1416-484d-be6d-afdc497d4075 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.info" returned: 0 in 0.638s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:23 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-96b09e01-1416-484d-be6d-afdc497d4075 tempest-CreateVolumesFromSnapshotTest-546590517 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.info is being set with open permissions: ugo+rw Jun 03 12:07:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-96b09e01-1416-484d-be6d-afdc497d4075 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:23 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.info Jun 03 12:07:23 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:23 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD" returned: 1 in 0.694s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:07:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:24 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-96b09e01-1416-484d-be6d-afdc497d4075 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.info" returned: 0 in 0.614s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-96b09e01-1416-484d-be6d-afdc497d4075 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.203s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.097s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1372373438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50a8d17-b065-4fee-a93e-9acbffa6c981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c3129e0c0b4264aa94af3e6181eff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:21Z,use_quota=True,user_id='69cbc18134214d10a7785e1dda1a6eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:07:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Creating volume f50a8d17-b065-4fee-a93e-9acbffa6c981 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:07:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:07:24 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:07:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:24 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 1073741824 Jun 03 12:07:24 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:24 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-96b09e01-1416-484d-be6d-afdc497d4075 tempest-CreateVolumesFromSnapshotTest-546590517 None] Create snapshot completed successfully Jun 03 12:07:24 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 1073741824" returned: 0 in 0.792s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:25 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 Jun 03 12:07:25 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:07:25 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Flow 'volume_create_manager' (c41b8207-2a28-45b5-a6f3-86a7787cfafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a55d20-3de2-40ce-8ec5-0c8d61f88ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981" returned: 0 in 0.645s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.825s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d2f47ed-776b-4479-b1af-09b65e961da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe37d81afd074cfcba8ed3c7f7290d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:20Z,use_quota=True,user_id='73cefe72789b42eaad8e7c8bded0a608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c38dcf29-d5e0-44de-985b-8391f208322c),volume_type_id=c38dcf29-d5e0-44de-985b-8391f208322c)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Creating volume 4d2f47ed-776b-4479-b1af-09b65e961da2 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:07:25 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a55d20-3de2-40ce-8ec5-0c8d61f88ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1030370180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9327bac6-cd1e-4e9f-a7bc-05f305012798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd5ef757d024d1f965877ae37795f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:26Z,use_quota=True,user_id='8f4a8419d7914a8488e2de67ffff08de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:25 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2 1073741824 Jun 03 12:07:25 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb00f8f-d0fe-4b8c-bff0-5dd1f9d37a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb00f8f-d0fe-4b8c-bff0-5dd1f9d37a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed3023e-465a-498d-990a-6c392d03a5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed3023e-465a-498d-990a-6c392d03a5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9327bac6-cd1e-4e9f-a7bc-05f305012798', 'volume_name': 'volume-9327bac6-cd1e-4e9f-a7bc-05f305012798', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1629287d-e6a0-4a37-8648-912a403c4dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1629287d-e6a0-4a37-8648-912a403c4dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf8e999-6900-49b4-828f-6df883ba29a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:25 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Volume 9327bac6-cd1e-4e9f-a7bc-05f305012798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9327bac6-cd1e-4e9f-a7bc-05f305012798', 'volume_size': 1} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce364eb-c7e2-4753-ba72-70f0154b048b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f50a8d17-b065-4fee-a93e-9acbffa6c981', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165ff8dd-8d14-4c63-ac62-490b60ba207c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:25 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Volume volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 (f50a8d17-b065-4fee-a93e-9acbffa6c981): created successfully Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165ff8dd-8d14-4c63-ac62-490b60ba207c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Flow 'volume_create_manager' (67de8e42-fcf0-4cda-967f-d0806f39bb69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:25 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-1d16ddac-7813-4730-9806-4ca34a0a10c1 tempest-VolumesSnapshotTestJSON-1501817216 None] Created volume successfully. Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Flow 'volume_create_manager' (fcb66849-5b6a-427b-89da-bcb0c80aa6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7432072-2b47-4b31-948e-5280872d61d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7432072-2b47-4b31-948e-5280872d61d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-668797087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc5a2cd-e686-435e-aa76-ce57265d60c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd5ef757d024d1f965877ae37795f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:26Z,use_quota=True,user_id='8f4a8419d7914a8488e2de67ffff08de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a4fdf7-a8a3-4a87-b22d-d3ae47f0a1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a4fdf7-a8a3-4a87-b22d-d3ae47f0a1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f6fc30-e2b6-4cef-8e60-adb19e44a764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f6fc30-e2b6-4cef-8e60-adb19e44a764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cc5a2cd-e686-435e-aa76-ce57265d60c5', 'volume_name': 'volume-9cc5a2cd-e686-435e-aa76-ce57265d60c5', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe58a0cc-d152-4ff1-9630-a8013d11241b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe58a0cc-d152-4ff1-9630-a8013d11241b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d028c7df-4100-40a6-be4f-f7967c3f440c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:26 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Volume 9cc5a2cd-e686-435e-aa76-ce57265d60c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cc5a2cd-e686-435e-aa76-ce57265d60c5', 'volume_size': 1} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Flow 'volume_create_manager' (f2d57fde-7b90-42ce-b62a-473f4d33bddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe245be-3469-40d5-852e-6ad059c7c02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe245be-3469-40d5-852e-6ad059c7c02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1187479557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1816a634-a971-4b6f-a9be-d0f7bfabd5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd5ef757d024d1f965877ae37795f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:26Z,use_quota=True,user_id='8f4a8419d7914a8488e2de67ffff08de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77e9050-9945-4316-b01b-b96096900918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77e9050-9945-4316-b01b-b96096900918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc60d2b5-72d9-49ec-9edc-3c1af3380bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc60d2b5-72d9-49ec-9edc-3c1af3380bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1816a634-a971-4b6f-a9be-d0f7bfabd5e6', 'volume_name': 'volume-1816a634-a971-4b6f-a9be-d0f7bfabd5e6', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaea0a83-8532-4721-878a-8935355622e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaea0a83-8532-4721-878a-8935355622e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b1a420-8fee-4ae8-8af8-bf4c0e52058a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:26 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Volume 1816a634-a971-4b6f-a9be-d0f7bfabd5e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1816a634-a971-4b6f-a9be-d0f7bfabd5e6', 'volume_size': 1} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c478557d-c095-47f8-802a-8345d5f3c44a tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:26 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2 1073741824" returned: 0 in 0.963s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:26 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2 Jun 03 12:07:26 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Flow 'volume_create_manager' (37cfb0fa-73af-43bc-9572-7bd3ee016512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41582eb5-8555-49fd-aff2-c149f6efc791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41582eb5-8555-49fd-aff2-c149f6efc791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-225216637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd5ef757d024d1f965877ae37795f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:27Z,use_quota=True,user_id='8f4a8419d7914a8488e2de67ffff08de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2603d0d8-22d0-4110-9244-b16d8ba2cdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2603d0d8-22d0-4110-9244-b16d8ba2cdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383cd923-a4ee-4b1f-b65d-86b447b83547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383cd923-a4ee-4b1f-b65d-86b447b83547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4', 'volume_name': 'volume-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde6238e-2301-4e72-8032-3833e827fddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde6238e-2301-4e72-8032-3833e827fddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a428444-a0db-4c72-bf7e-4357319d98a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:26 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Volume 75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4', 'volume_size': 1} Jun 03 12:07:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Flow 'volume_create_manager' (10ffdc50-48de-409c-9de0-f17e1da14dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60bdf06-ef9b-4486-bdbe-33294c3cb424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60bdf06-ef9b-4486-bdbe-33294c3cb424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1117637909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47816a06-531a-4b99-921f-7a8a128e2063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd5ef757d024d1f965877ae37795f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:27Z,use_quota=True,user_id='8f4a8419d7914a8488e2de67ffff08de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e6d906-e9d9-4171-9918-ca67a41f88a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e6d906-e9d9-4171-9918-ca67a41f88a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18727803-6c6c-46a2-aeaf-c6f6a150da9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18727803-6c6c-46a2-aeaf-c6f6a150da9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47816a06-531a-4b99-921f-7a8a128e2063', 'volume_name': 'volume-47816a06-531a-4b99-921f-7a8a128e2063', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aec2e49-07c2-4172-9726-82b61682a611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aec2e49-07c2-4172-9726-82b61682a611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42d4ff82-dd05-424f-904c-30aaf624b340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:27 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Volume 47816a06-531a-4b99-921f-7a8a128e2063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47816a06-531a-4b99-921f-7a8a128e2063', 'volume_size': 1} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:27 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2" returned: 0 in 0.670s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.617s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1030370180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9327bac6-cd1e-4e9f-a7bc-05f305012798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd5ef757d024d1f965877ae37795f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:26Z,use_quota=True,user_id='8f4a8419d7914a8488e2de67ffff08de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Creating volume 9327bac6-cd1e-4e9f-a7bc-05f305012798 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:07:27 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9327bac6-cd1e-4e9f-a7bc-05f305012798 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:27 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9327bac6-cd1e-4e9f-a7bc-05f305012798 1073741824 Jun 03 12:07:27 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Attempting download of c817a8fc-f071-4060-a67c-941e49dd2b38 ((None, [{'url': 'file:///opt/stack/data/glance/images/c817a8fc-f071-4060-a67c-941e49dd2b38', 'metadata': {}}])) to volume 4d2f47ed-776b-4479-b1af-09b65e961da2. {{(pid=86724) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad67737d-c794-4c69-bd08-5096b45f07dc]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c817a8fc-f071-4060-a67c-941e49dd2b38_57klra7t {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:27 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c817a8fc-f071-4060-a67c-941e49dd2b38_57klra7t Jun 03 12:07:27 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:28 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c817a8fc-f071-4060-a67c-941e49dd2b38_57klra7t" returned: 0 in 0.720s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c817a8fc-f071-4060-a67c-941e49dd2b38_57klra7t {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:28 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9327bac6-cd1e-4e9f-a7bc-05f305012798 1073741824" returned: 0 in 0.807s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9327bac6-cd1e-4e9f-a7bc-05f305012798 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:28 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9327bac6-cd1e-4e9f-a7bc-05f305012798 Jun 03 12:07:28 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:28 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c817a8fc-f071-4060-a67c-941e49dd2b38_57klra7t Jun 03 12:07:28 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:28 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9327bac6-cd1e-4e9f-a7bc-05f305012798" returned: 0 in 0.601s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.775s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:28 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-668797087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc5a2cd-e686-435e-aa76-ce57265d60c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd5ef757d024d1f965877ae37795f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:26Z,use_quota=True,user_id='8f4a8419d7914a8488e2de67ffff08de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Creating volume 9cc5a2cd-e686-435e-aa76-ce57265d60c5 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:07:28 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9cc5a2cd-e686-435e-aa76-ce57265d60c5 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c817a8fc-f071-4060-a67c-941e49dd2b38_57klra7t" returned: 1 in 0.687s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c817a8fc-f071-4060-a67c-941e49dd2b38_57klra7t' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b4a582-678d-476f-b3ab-5e0ecdd55777]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:28 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9cc5a2cd-e686-435e-aa76-ce57265d60c5 1073741824 Jun 03 12:07:28 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf8e999-6900-49b4-828f-6df883ba29a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9327bac6-cd1e-4e9f-a7bc-05f305012798', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170da8a1-dfcf-4cd5-a5da-6e96133bb058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:28 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Volume volume-9327bac6-cd1e-4e9f-a7bc-05f305012798 (9327bac6-cd1e-4e9f-a7bc-05f305012798): created successfully Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170da8a1-dfcf-4cd5-a5da-6e96133bb058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Flow 'volume_create_manager' (c41b8207-2a28-45b5-a6f3-86a7787cfafc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:28 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a347aa3d-76da-4b37-8696-eb7c56fbe866 tempest-CreateVolumesFromSnapshotTest-546590517 None] Created volume successfully. Jun 03 12:07:28 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD Jun 03 12:07:28 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:29 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD" returned: 0 in 0.737s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:29 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9cc5a2cd-e686-435e-aa76-ce57265d60c5 1073741824" returned: 0 in 0.815s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9cc5a2cd-e686-435e-aa76-ce57265d60c5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:29 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD Jun 03 12:07:29 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:29 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9cc5a2cd-e686-435e-aa76-ce57265d60c5 Jun 03 12:07:29 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:30 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD" returned: 1 in 0.745s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:07:30 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] c817a8fc-f071-4060-a67c-941e49dd2b38 was raw, converting to raw {{(pid=86724) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 03 12:07:30 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9cc5a2cd-e686-435e-aa76-ce57265d60c5" returned: 0 in 0.678s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:30 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:07:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.920s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:30 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1187479557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1816a634-a971-4b6f-a9be-d0f7bfabd5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd5ef757d024d1f965877ae37795f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:26Z,use_quota=True,user_id='8f4a8419d7914a8488e2de67ffff08de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:07:30 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Creating volume 1816a634-a971-4b6f-a9be-d0f7bfabd5e6 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:07:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:30 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:30 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2 Jun 03 12:07:30 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:30 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:07:30 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:07:30 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1816a634-a971-4b6f-a9be-d0f7bfabd5e6 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d028c7df-4100-40a6-be4f-f7967c3f440c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cc5a2cd-e686-435e-aa76-ce57265d60c5', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:30 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1816a634-a971-4b6f-a9be-d0f7bfabd5e6 1073741824 Jun 03 12:07:30 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486cf717-6f96-4343-9202-287a2d425618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:30 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Volume volume-9cc5a2cd-e686-435e-aa76-ce57265d60c5 (9cc5a2cd-e686-435e-aa76-ce57265d60c5): created successfully Jun 03 12:07:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486cf717-6f96-4343-9202-287a2d425618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Flow 'volume_create_manager' (fcb66849-5b6a-427b-89da-bcb0c80aa6ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:30 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-51dd415b-c979-472e-8b5d-88605062b720 tempest-CreateVolumesFromSnapshotTest-546590517 None] Created volume successfully. Jun 03 12:07:31 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2" returned: 0 in 0.781s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:31 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c817a8fc-f071-4060-a67c-941e49dd2b38_lpdfc_80devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2 {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 12:07:31 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Converted 0.00 MB image at 0.00 MB/s Jun 03 12:07:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:31 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2 1G Jun 03 12:07:31 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:31 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1816a634-a971-4b6f-a9be-d0f7bfabd5e6 1073741824" returned: 0 in 0.845s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1816a634-a971-4b6f-a9be-d0f7bfabd5e6 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:31 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1816a634-a971-4b6f-a9be-d0f7bfabd5e6 Jun 03 12:07:31 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:31 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2 1G" returned: 0 in 0.707s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:31 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1816a634-a971-4b6f-a9be-d0f7bfabd5e6" returned: 0 in 0.623s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:31 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:07:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:31 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0a414d-84b0-45ac-ae39-1364b7d6ded5]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c478557d-c095-47f8-802a-8345d5f3c44a tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.296s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:31 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b1a420-8fee-4ae8-8af8-bf4c0e52058a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1816a634-a971-4b6f-a9be-d0f7bfabd5e6', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:31 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54e82c7-106f-451c-b9a2-2d8d799bd35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:31 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-c478557d-c095-47f8-802a-8345d5f3c44a tempest-VolumesSnapshotTestJSON-1501817216 None] Creating offline snapshot 41eb1936-1501-4f7d-8d6b-5080b8cc5380 of volume f50a8d17-b065-4fee-a93e-9acbffa6c981 {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 12:07:31 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Volume volume-1816a634-a971-4b6f-a9be-d0f7bfabd5e6 (1816a634-a971-4b6f-a9be-d0f7bfabd5e6): created successfully Jun 03 12:07:31 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54e82c7-106f-451c-b9a2-2d8d799bd35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:31 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Flow 'volume_create_manager' (f2d57fde-7b90-42ce-b62a-473f4d33bddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:31 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6266f3-2e73-460a-878d-6dc5018ed2cd]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c478557d-c095-47f8-802a-8345d5f3c44a tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:31 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-442be0be-90fb-4835-b244-996a96e169cf tempest-CreateVolumesFromSnapshotTest-546590517 None] Created volume successfully. Jun 03 12:07:31 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2 Jun 03 12:07:31 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:32 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 Jun 03 12:07:32 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:32 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2" returned: 0 in 0.729s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:32 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c478557d-c095-47f8-802a-8345d5f3c44a tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981" returned: 0 in 0.764s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:32 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2 Jun 03 12:07:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c478557d-c095-47f8-802a-8345d5f3c44a tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:32 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:32 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380 1G Jun 03 12:07:32 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:33 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2" returned: 1 in 0.736s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:07:33 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Downloaded image c817a8fc-f071-4060-a67c-941e49dd2b38 ((None, [{'url': 'file:///opt/stack/data/glance/images/c817a8fc-f071-4060-a67c-941e49dd2b38', 'metadata': {}}])) to volume 4d2f47ed-776b-4479-b1af-09b65e961da2 successfully. {{(pid=86724) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 03 12:07:33 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Temporary image c817a8fc-f071-4060-a67c-941e49dd2b38 for user 73cefe72789b42eaad8e7c8bded0a608 is deleted. {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 03 12:07:33 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Marking volume 4d2f47ed-776b-4479-b1af-09b65e961da2 as bootable. {{(pid=86724) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 03 12:07:33 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Copying metadata from image c817a8fc-f071-4060-a67c-941e49dd2b38 to 4d2f47ed-776b-4479-b1af-09b65e961da2. {{(pid=86724) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 03 12:07:33 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Creating volume glance metadata for volume 4d2f47ed-776b-4479-b1af-09b65e961da2 backed by image c817a8fc-f071-4060-a67c-941e49dd2b38 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c817a8fc-f071-4060-a67c-941e49dd2b38', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8b2b704f99c7eb58528d8092102954b9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86724) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 03 12:07:33 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3669e04-4292-4b63-bd38-6455c10f9559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d2f47ed-776b-4479-b1af-09b65e961da2', 'volume_size': 1, 'image_id': 'c817a8fc-f071-4060-a67c-941e49dd2b38', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c817a8fc-f071-4060-a67c-941e49dd2b38', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8b2b704f99c7eb58528d8092102954b9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fe37d81afd074cfcba8ed3c7f7290d45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a8ce0b5e61c91fac0dd32ed348834829dfbc1d634813107a0a4243cf33b79e4ef0558a8d492b3f68bb2a65b5c76de9c805b2fd434275f0555363c3c83f27c156', 'id': 'c817a8fc-f071-4060-a67c-941e49dd2b38', 'created_at': datetime.datetime(2026, 6, 3, 10, 7, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 10, 7, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c817a8fc-f071-4060-a67c-941e49dd2b38/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:33 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8e080c-d34f-4d60-8e81-87dfa54b1905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:33 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Volume volume-4d2f47ed-776b-4479-b1af-09b65e961da2 (4d2f47ed-776b-4479-b1af-09b65e961da2): created successfully Jun 03 12:07:33 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8e080c-d34f-4d60-8e81-87dfa54b1905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:33 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Flow 'volume_create_manager' (0ef4f68f-f7bc-4e43-997b-d03421c4583c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:33 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-699d7861-b0f6-404f-b74a-3684abea207b tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Created volume successfully. Jun 03 12:07:33 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c478557d-c095-47f8-802a-8345d5f3c44a tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380 1G" returned: 0 in 0.815s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c478557d-c095-47f8-802a-8345d5f3c44a tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:33 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380 Jun 03 12:07:33 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:34 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c478557d-c095-47f8-802a-8345d5f3c44a tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380" returned: 0 in 0.665s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:34 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-c478557d-c095-47f8-802a-8345d5f3c44a tempest-VolumesSnapshotTestJSON-1501817216 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380 is being set with open permissions: ugo+rw Jun 03 12:07:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c478557d-c095-47f8-802a-8345d5f3c44a tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:34 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380 Jun 03 12:07:34 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Acquiring lock "cinder-4d2f47ed-776b-4479-b1af-09b65e961da2-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Lock "cinder-4d2f47ed-776b-4479-b1af-09b65e961da2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Acquiring lock "cinder-quobyte-4d2f47ed-776b-4479-b1af-09b65e961da2" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Lock "cinder-quobyte-4d2f47ed-776b-4479-b1af-09b65e961da2" acquired by "delete_volume" :: waited 0.015s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:34 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd6288e-adda-4300-b624-0bf45ed4afa9]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:34 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2 Jun 03 12:07:34 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:34 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c478557d-c095-47f8-802a-8345d5f3c44a tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380" returned: 0 in 0.617s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c478557d-c095-47f8-802a-8345d5f3c44a tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:34 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.info Jun 03 12:07:34 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:35 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2" returned: 0 in 0.729s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:35 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2 Jun 03 12:07:35 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:35 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c478557d-c095-47f8-802a-8345d5f3c44a tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.info" returned: 0 in 0.645s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:35 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-c478557d-c095-47f8-802a-8345d5f3c44a tempest-VolumesSnapshotTestJSON-1501817216 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.info is being set with open permissions: ugo+rw Jun 03 12:07:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c478557d-c095-47f8-802a-8345d5f3c44a tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:35 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.info Jun 03 12:07:35 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:35 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2" returned: 1 in 0.702s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:07:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:35 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2 Jun 03 12:07:35 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:36 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c478557d-c095-47f8-802a-8345d5f3c44a tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.info" returned: 0 in 0.622s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c478557d-c095-47f8-802a-8345d5f3c44a tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.270s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.346s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-225216637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd5ef757d024d1f965877ae37795f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:27Z,use_quota=True,user_id='8f4a8419d7914a8488e2de67ffff08de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Creating volume 75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:07:36 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:36 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4 1073741824 Jun 03 12:07:36 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:36 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c478557d-c095-47f8-802a-8345d5f3c44a tempest-VolumesSnapshotTestJSON-1501817216 None] Create snapshot completed successfully Jun 03 12:07:36 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4d2f47ed-776b-4479-b1af-09b65e961da2" returned: 0 in 0.639s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Lock "cinder-quobyte-4d2f47ed-776b-4479-b1af-09b65e961da2" released by "delete_volume" :: held 2.134s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:36 devstack cinder-volume[86724]: WARNING cinder.quota [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 03 12:07:36 devstack cinder-volume[86724]: WARNING cinder.quota [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Created reservations ['c64d79eb-0cac-4d94-9b8c-c35fc4ad6340', '7b9cef6d-c8b3-491a-b8b4-362757e6c9cc', '61c386ca-cfb8-4be5-a85c-43bbdaad7c8a', '425524d5-63c6-4e3c-8e8b-9a40ca484c08'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:36 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:07:36 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:36 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4 1073741824" returned: 0 in 0.852s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:37 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:07:37 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:37 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4 Jun 03 12:07:37 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:37 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.701s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:07:37 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Deleted volume successfully. Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e34e5a35-861a-4281-aeac-c8e16644651d tempest-VolumeAndVolumeTypeFromImageTest-1862782341 None] Lock "cinder-4d2f47ed-776b-4479-b1af-09b65e961da2-delete_volume" released by "delete_volume" :: held 3.060s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Flow 'volume_create_manager' (fd0fc6b9-8d71-4e31-ab17-ef3aa73089ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f4d6d6-9811-4dbe-aac9-e22d3685ca65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f4d6d6-9811-4dbe-aac9-e22d3685ca65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-185915582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90600fe4-cecc-4b50-a5dd-ab73c0f4ee16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c3129e0c0b4264aa94af3e6181eff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=41eb1936-1501-4f7d-8d6b-5080b8cc5380,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:37Z,use_quota=True,user_id='69cbc18134214d10a7785e1dda1a6eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fcb0ef3-7767-4c0d-a874-5b12cb716492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fcb0ef3-7767-4c0d-a874-5b12cb716492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (380a8691-64a6-4543-889f-b16da73b225d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (380a8691-64a6-4543-889f-b16da73b225d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '90600fe4-cecc-4b50-a5dd-ab73c0f4ee16', 'volume_name': 'volume-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16', 'volume_size': 2, 'snapshot_id': '41eb1936-1501-4f7d-8d6b-5080b8cc5380'}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad19b9ee-d2ee-4f00-af08-2c4f11814a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad19b9ee-d2ee-4f00-af08-2c4f11814a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fcb8e0-2974-4e7e-9e5d-a449868bd42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:37 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Volume 90600fe4-cecc-4b50-a5dd-ab73c0f4ee16: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16', 'volume_size': 2, 'snapshot_id': '41eb1936-1501-4f7d-8d6b-5080b8cc5380'} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:37 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.739s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:07:37 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4" returned: 0 in 0.759s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.701s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1117637909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47816a06-531a-4b99-921f-7a8a128e2063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd5ef757d024d1f965877ae37795f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:27Z,use_quota=True,user_id='8f4a8419d7914a8488e2de67ffff08de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Creating volume 47816a06-531a-4b99-921f-7a8a128e2063 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:07:37 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-47816a06-531a-4b99-921f-7a8a128e2063 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a428444-a0db-4c72-bf7e-4357319d98a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:37 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-47816a06-531a-4b99-921f-7a8a128e2063 1073741824 Jun 03 12:07:37 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61be1435-3382-4bf4-b40e-7d4f60fbef70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:37 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Volume volume-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4 (75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4): created successfully Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61be1435-3382-4bf4-b40e-7d4f60fbef70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Flow 'volume_create_manager' (37cfb0fa-73af-43bc-9572-7bd3ee016512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:37 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-949b7270-b08e-461a-b7ee-e9f61beea198 tempest-CreateVolumesFromSnapshotTest-546590517 None] Created volume successfully. Jun 03 12:07:38 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-47816a06-531a-4b99-921f-7a8a128e2063 1073741824" returned: 0 in 0.867s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-47816a06-531a-4b99-921f-7a8a128e2063 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:38 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-47816a06-531a-4b99-921f-7a8a128e2063 Jun 03 12:07:38 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:39 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-47816a06-531a-4b99-921f-7a8a128e2063" returned: 0 in 0.682s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.820s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-quobyte-41eb1936-1501-4f7d-8d6b-5080b8cc5380-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16" by "_create_volume_from_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42d4ff82-dd05-424f-904c-30aaf624b340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47816a06-531a-4b99-921f-7a8a128e2063', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de93f29-fa43-4cb1-9810-195cf7084ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-41eb1936-1501-4f7d-8d6b-5080b8cc5380-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Creating volume 90600fe4-cecc-4b50-a5dd-ab73c0f4ee16 from snapshot 41eb1936-1501-4f7d-8d6b-5080b8cc5380 {{(pid=86724) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-quobyte-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16" by "_copy_volume_from_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:39 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Volume volume-47816a06-531a-4b99-921f-7a8a128e2063 (47816a06-531a-4b99-921f-7a8a128e2063): created successfully Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de93f29-fa43-4cb1-9810-195cf7084ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Flow 'volume_create_manager' (10ffdc50-48de-409c-9de0-f17e1da14dab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] snapshot: 41eb1936-1501-4f7d-8d6b-5080b8cc5380, volume: 90600fe4-cecc-4b50-a5dd-ab73c0f4ee16, {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 12:07:39 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-bf8b4fdc-987e-42cf-9dde-1b27a32cc2ea tempest-CreateVolumesFromSnapshotTest-546590517 None] Created volume successfully. Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d405e9e-b34e-4785-92c3-401f0396eac6]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:39 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380 Jun 03 12:07:39 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:40 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0bd04553-db1b-433d-92ba-9cb8dd32540a tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "cinder-47816a06-531a-4b99-921f-7a8a128e2063-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:40 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0bd04553-db1b-433d-92ba-9cb8dd32540a tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-47816a06-531a-4b99-921f-7a8a128e2063-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:40 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0bd04553-db1b-433d-92ba-9cb8dd32540a tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "cinder-quobyte-47816a06-531a-4b99-921f-7a8a128e2063" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:40 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0bd04553-db1b-433d-92ba-9cb8dd32540a tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-quobyte-47816a06-531a-4b99-921f-7a8a128e2063" acquired by "delete_volume" :: waited 0.017s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:40 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74a3117-7573-4581-b841-2a4a218b1b85]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0bd04553-db1b-433d-92ba-9cb8dd32540a tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-47816a06-531a-4b99-921f-7a8a128e2063 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:40 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-47816a06-531a-4b99-921f-7a8a128e2063 Jun 03 12:07:40 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:40 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380" returned: 0 in 0.799s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f50a8d17-b065-4fee-a93e-9acbffa6c981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:07:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] will copy from snapshot at /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 12:07:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Creating direct copy from snapshot {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 12:07:40 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2603ea9-dfd1-4887-9cda-7a59e7bf679f]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:40 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 Jun 03 12:07:40 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:41 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0bd04553-db1b-433d-92ba-9cb8dd32540a tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-47816a06-531a-4b99-921f-7a8a128e2063" returned: 0 in 0.822s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0bd04553-db1b-433d-92ba-9cb8dd32540a tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-47816a06-531a-4b99-921f-7a8a128e2063 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:41 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-47816a06-531a-4b99-921f-7a8a128e2063 Jun 03 12:07:41 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:41 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981" returned: 0 in 0.809s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:41 devstack cinder-volume[86724]: DEBUG cinder.utils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Path /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16 not found in is_blk_device check {{(pid=86724) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 03 12:07:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:41 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16 Jun 03 12:07:41 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:41 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0bd04553-db1b-433d-92ba-9cb8dd32540a tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-47816a06-531a-4b99-921f-7a8a128e2063" returned: 0 in 0.652s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0bd04553-db1b-433d-92ba-9cb8dd32540a tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-quobyte-47816a06-531a-4b99-921f-7a8a128e2063" released by "delete_volume" :: held 1.532s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:41 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-0bd04553-db1b-433d-92ba-9cb8dd32540a tempest-CreateVolumesFromSnapshotTest-546590517 None] Created reservations ['e10515e3-8134-4348-a72b-65be9ecfc430', 'a13595d6-f825-4503-b124-8dfea03b82d9', 'dec220c0-8083-4ed3-995f-d7d0cce5978c', '408aec17-c6fc-45eb-b06a-4b49e60bfd2d'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:07:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0bd04553-db1b-433d-92ba-9cb8dd32540a tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0bd04553-db1b-433d-92ba-9cb8dd32540a tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:41 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0bd04553-db1b-433d-92ba-9cb8dd32540a tempest-CreateVolumesFromSnapshotTest-546590517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:41 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0bd04553-db1b-433d-92ba-9cb8dd32540a tempest-CreateVolumesFromSnapshotTest-546590517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0bd04553-db1b-433d-92ba-9cb8dd32540a tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0bd04553-db1b-433d-92ba-9cb8dd32540a tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:41 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:07:41 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b4eaa63f-eb6b-418a-a14b-e2abec2114bf tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "cinder-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b4eaa63f-eb6b-418a-a14b-e2abec2114bf tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b4eaa63f-eb6b-418a-a14b-e2abec2114bf tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "cinder-quobyte-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b4eaa63f-eb6b-418a-a14b-e2abec2114bf tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-quobyte-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4" acquired by "delete_volume" :: waited 0.043s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:42 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe754ad3-161b-459d-bc57-cab00d29d98b]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b4eaa63f-eb6b-418a-a14b-e2abec2114bf tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:43 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0bd04553-db1b-433d-92ba-9cb8dd32540a tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.227s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:43 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-0bd04553-db1b-433d-92ba-9cb8dd32540a tempest-CreateVolumesFromSnapshotTest-546590517 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:07:43 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-0bd04553-db1b-433d-92ba-9cb8dd32540a tempest-CreateVolumesFromSnapshotTest-546590517 None] Deleted volume successfully. Jun 03 12:07:43 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0bd04553-db1b-433d-92ba-9cb8dd32540a tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-47816a06-531a-4b99-921f-7a8a128e2063-delete_volume" released by "delete_volume" :: held 3.097s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:43 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4 Jun 03 12:07:43 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:45 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b4eaa63f-eb6b-418a-a14b-e2abec2114bf tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4" returned: 0 in 2.180s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b4eaa63f-eb6b-418a-a14b-e2abec2114bf tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:45 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4 Jun 03 12:07:45 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:46 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b4eaa63f-eb6b-418a-a14b-e2abec2114bf tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4" returned: 0 in 1.375s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:46 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b4eaa63f-eb6b-418a-a14b-e2abec2114bf tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-quobyte-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4" released by "delete_volume" :: held 3.709s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:46 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-b4eaa63f-eb6b-418a-a14b-e2abec2114bf tempest-CreateVolumesFromSnapshotTest-546590517 None] Created reservations ['515bf24e-2bc8-4e3c-9017-1890e143e287', '6adbab45-cf45-48b5-b158-ad500ad98a42', 'cb8a0eb0-1734-4ed4-872f-33ddbc1f4699', 'f7d29c58-750c-4092-bc95-b71f74eddd2b'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:07:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b4eaa63f-eb6b-418a-a14b-e2abec2114bf tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b4eaa63f-eb6b-418a-a14b-e2abec2114bf tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:46 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b4eaa63f-eb6b-418a-a14b-e2abec2114bf tempest-CreateVolumesFromSnapshotTest-546590517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:46 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b4eaa63f-eb6b-418a-a14b-e2abec2114bf tempest-CreateVolumesFromSnapshotTest-546590517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b4eaa63f-eb6b-418a-a14b-e2abec2114bf tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b4eaa63f-eb6b-418a-a14b-e2abec2114bf tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:46 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:07:46 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:46 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16" returned: 0 in 5.784s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:46 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3864157-6f18-4691-b226-4637f25cf5cf]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:47 devstack sudo[103058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 Jun 03 12:07:47 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-6ea829de-f867-4085-b168-c7b5508758a2 tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "cinder-1816a634-a971-4b6f-a9be-d0f7bfabd5e6-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-6ea829de-f867-4085-b168-c7b5508758a2 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-1816a634-a971-4b6f-a9be-d0f7bfabd5e6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-6ea829de-f867-4085-b168-c7b5508758a2 tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "cinder-quobyte-1816a634-a971-4b6f-a9be-d0f7bfabd5e6" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:47 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b4eaa63f-eb6b-418a-a14b-e2abec2114bf tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.671s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:47 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-b4eaa63f-eb6b-418a-a14b-e2abec2114bf tempest-CreateVolumesFromSnapshotTest-546590517 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:07:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-6ea829de-f867-4085-b168-c7b5508758a2 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-quobyte-1816a634-a971-4b6f-a9be-d0f7bfabd5e6" acquired by "delete_volume" :: waited 0.015s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:47 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-b4eaa63f-eb6b-418a-a14b-e2abec2114bf tempest-CreateVolumesFromSnapshotTest-546590517 None] Deleted volume successfully. Jun 03 12:07:47 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b33087-75ec-457d-9e8b-f44399793826]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6ea829de-f867-4085-b168-c7b5508758a2 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1816a634-a971-4b6f-a9be-d0f7bfabd5e6 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b4eaa63f-eb6b-418a-a14b-e2abec2114bf tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-75da0b78-f2c7-4bd9-b5f4-6ded6164ecc4-delete_volume" released by "delete_volume" :: held 5.062s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:47 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1816a634-a971-4b6f-a9be-d0f7bfabd5e6 Jun 03 12:07:47 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:48 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=107,cinder:INSERT=35,cinder:UPDATE=119,cinder:DELETE=9 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981" returned: 0 in 1.054s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Image conversion details: src /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16 {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 12:07:48 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Converted 1024.00 MB image at 176.99 MB/s Jun 03 12:07:48 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16 is being set with open permissions: ugo+rw Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=95,cinder:INSERT=31,cinder:UPDATE=115,cinder:DELETE=12 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:07:48 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16 Jun 03 12:07:48 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Flow 'volume_create_manager' (7d50213a-373a-4be3-ad37-84c9426a0f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd9441c-4e34-4561-b5de-f13460851d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd9441c-4e34-4561-b5de-f13460851d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9cdef5-8e05-46fb-9ed0-6174863a9a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb51991c7164da494f4ba545400cc2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:48Z,use_quota=True,user_id='6566eacabf2346e4ae10519d81c917c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c56dbf2-9836-47f0-90e5-a9cecf8c61ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c56dbf2-9836-47f0-90e5-a9cecf8c61ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ffe3077-4698-4e59-aee1-446bd6f7642d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG cinder.image.glance [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Creating Keystone auth plugin from conf {{(pid=86724) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 03 12:07:48 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6ea829de-f867-4085-b168-c7b5508758a2 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1816a634-a971-4b6f-a9be-d0f7bfabd5e6" returned: 0 in 0.802s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6ea829de-f867-4085-b168-c7b5508758a2 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1816a634-a971-4b6f-a9be-d0f7bfabd5e6 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:48 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1816a634-a971-4b6f-a9be-d0f7bfabd5e6 Jun 03 12:07:48 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ffe3077-4698-4e59-aee1-446bd6f7642d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be9cdef5-8e05-46fb-9ed0-6174863a9a98', 'volume_name': 'volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98', 'volume_size': 1, 'image_id': '0c9449e8-19a7-462a-8b9a-7869ad3d8ed9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c9449e8-19a7-462a-8b9a-7869ad3d8ed9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'de34eefad489a1d1bff7fcd5df8ef54a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4eb51991c7164da494f4ba545400cc2d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5374aadd0f9c84d396062f6f06890296934408cab5615bc929db03201b79d520c6f555dac8e1b88485d55e06d51555a7170cb1aafe8c5ccf5135973c1d070859', 'id': '0c9449e8-19a7-462a-8b9a-7869ad3d8ed9', 'created_at': datetime.datetime(2026, 6, 3, 10, 7, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 10, 7, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c9449e8-19a7-462a-8b9a-7869ad3d8ed9/file', 'properties': {}}, 'image_service': }' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3231dc05-a0cb-4bde-88e9-f24e47ff6a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3231dc05-a0cb-4bde-88e9-f24e47ff6a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2123837-fa07-4bd3-a7f1-1192c39fe356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:48 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Volume be9cdef5-8e05-46fb-9ed0-6174863a9a98: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98', 'volume_size': 1, 'image_id': '0c9449e8-19a7-462a-8b9a-7869ad3d8ed9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c9449e8-19a7-462a-8b9a-7869ad3d8ed9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'de34eefad489a1d1bff7fcd5df8ef54a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4eb51991c7164da494f4ba545400cc2d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5374aadd0f9c84d396062f6f06890296934408cab5615bc929db03201b79d520c6f555dac8e1b88485d55e06d51555a7170cb1aafe8c5ccf5135973c1d070859', 'id': '0c9449e8-19a7-462a-8b9a-7869ad3d8ed9', 'created_at': datetime.datetime(2026, 6, 3, 10, 7, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 10, 7, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c9449e8-19a7-462a-8b9a-7869ad3d8ed9/file', 'properties': {}}, 'image_service': } Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Trying to clone be9cdef5-8e05-46fb-9ed0-6174863a9a98 from image 0c9449e8-19a7-462a-8b9a-7869ad3d8ed9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0c9449e8-19a7-462a-8b9a-7869ad3d8ed9', 'metadata': {}}]). {{(pid=86724) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 03 12:07:48 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Image download 0.00 MB at 0.00 MB/s Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2421fb6-3d6d-4a69-8a2f-4bd30a7b339b]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:48 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD Jun 03 12:07:48 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:48 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16" returned: 0 in 0.708s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16" released by "_copy_volume_from_snapshot" :: held 9.269s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-41eb1936-1501-4f7d-8d6b-5080b8cc5380-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16" released by "_create_volume_from_snapshot" :: held 9.328s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.361s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fcb8e0-2974-4e7e-9e5d-a449868bd42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16', 'volume_size': 2, 'snapshot_id': '41eb1936-1501-4f7d-8d6b-5080b8cc5380'}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b4efe7-32b1-491e-b45f-8f449b8bcca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:48 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Volume volume-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16 (90600fe4-cecc-4b50-a5dd-ab73c0f4ee16): created successfully Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b4efe7-32b1-491e-b45f-8f449b8bcca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:48 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Flow 'volume_create_manager' (fd0fc6b9-8d71-4e31-ab17-ef3aa73089ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:48 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-98b7b774-a404-43a8-a9f7-25aa9644f136 tempest-VolumesSnapshotTestJSON-1501817216 None] Created volume successfully. Jun 03 12:07:49 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6ea829de-f867-4085-b168-c7b5508758a2 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1816a634-a971-4b6f-a9be-d0f7bfabd5e6" returned: 0 in 0.732s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-6ea829de-f867-4085-b168-c7b5508758a2 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-quobyte-1816a634-a971-4b6f-a9be-d0f7bfabd5e6" released by "delete_volume" :: held 1.594s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:49 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-6ea829de-f867-4085-b168-c7b5508758a2 tempest-CreateVolumesFromSnapshotTest-546590517 None] Created reservations ['a2ecc50f-8fba-4f67-8e5c-787d357c30ad', '4f4207df-ea2a-4048-897f-05dc36f1d42a', '690be8d5-328c-4a7c-85b2-779d3d820cf6', '78b8b9f8-cfaa-47e3-8539-4576af133d79'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:07:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6ea829de-f867-4085-b168-c7b5508758a2 tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6ea829de-f867-4085-b168-c7b5508758a2 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-6ea829de-f867-4085-b168-c7b5508758a2 tempest-CreateVolumesFromSnapshotTest-546590517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-6ea829de-f867-4085-b168-c7b5508758a2 tempest-CreateVolumesFromSnapshotTest-546590517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6ea829de-f867-4085-b168-c7b5508758a2 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6ea829de-f867-4085-b168-c7b5508758a2 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:49 devstack sudo[103079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:07:49 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:49 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD" returned: 0 in 0.719s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:49 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD Jun 03 12:07:49 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8fda16a6-5004-4901-a401-998366241ef9 tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "cinder-9cc5a2cd-e686-435e-aa76-ce57265d60c5-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8fda16a6-5004-4901-a401-998366241ef9 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-9cc5a2cd-e686-435e-aa76-ce57265d60c5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8fda16a6-5004-4901-a401-998366241ef9 tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "cinder-quobyte-9cc5a2cd-e686-435e-aa76-ce57265d60c5" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8fda16a6-5004-4901-a401-998366241ef9 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-quobyte-9cc5a2cd-e686-435e-aa76-ce57265d60c5" acquired by "delete_volume" :: waited 0.023s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:49 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb76549-e6ad-465b-9a1d-779e3b25c8bd]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8fda16a6-5004-4901-a401-998366241ef9 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9cc5a2cd-e686-435e-aa76-ce57265d60c5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:49 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6ea829de-f867-4085-b168-c7b5508758a2 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.662s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:49 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-6ea829de-f867-4085-b168-c7b5508758a2 tempest-CreateVolumesFromSnapshotTest-546590517 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:07:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4f819ef8-0088-45b5-9dbd-da3650372078 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:49 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-6ea829de-f867-4085-b168-c7b5508758a2 tempest-CreateVolumesFromSnapshotTest-546590517 None] Deleted volume successfully. Jun 03 12:07:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4f819ef8-0088-45b5-9dbd-da3650372078 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-6ea829de-f867-4085-b168-c7b5508758a2 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-1816a634-a971-4b6f-a9be-d0f7bfabd5e6-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:50 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9cc5a2cd-e686-435e-aa76-ce57265d60c5 Jun 03 12:07:50 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4f819ef8-0088-45b5-9dbd-da3650372078 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-quobyte-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4f819ef8-0088-45b5-9dbd-da3650372078 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16" acquired by "delete_volume" :: waited 0.019s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:50 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f337a96-7cd7-41d0-be66-9f194c992000]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4f819ef8-0088-45b5-9dbd-da3650372078 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:50 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD" returned: 1 in 0.814s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:07:50 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Temporary image 0c9449e8-19a7-462a-8b9a-7869ad3d8ed9 is fetched for user 6566eacabf2346e4ae10519d81c917c8. {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 03 12:07:50 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bfa298-3d8a-45f6-8794-3b4fac180326]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:50 devstack sudo[103089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16 Jun 03 12:07:50 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:50 devstack sudo[103091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD Jun 03 12:07:50 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:50 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8fda16a6-5004-4901-a401-998366241ef9 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9cc5a2cd-e686-435e-aa76-ce57265d60c5" returned: 0 in 0.767s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8fda16a6-5004-4901-a401-998366241ef9 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9cc5a2cd-e686-435e-aa76-ce57265d60c5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:50 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9cc5a2cd-e686-435e-aa76-ce57265d60c5 Jun 03 12:07:50 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:50 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4f819ef8-0088-45b5-9dbd-da3650372078 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16" returned: 0 in 0.846s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4f819ef8-0088-45b5-9dbd-da3650372078 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:50 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16 Jun 03 12:07:50 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:50 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD" returned: 0 in 0.761s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:51 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD Jun 03 12:07:51 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:51 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8fda16a6-5004-4901-a401-998366241ef9 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9cc5a2cd-e686-435e-aa76-ce57265d60c5" returned: 0 in 0.659s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8fda16a6-5004-4901-a401-998366241ef9 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-quobyte-9cc5a2cd-e686-435e-aa76-ce57265d60c5" released by "delete_volume" :: held 1.484s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-8fda16a6-5004-4901-a401-998366241ef9 tempest-CreateVolumesFromSnapshotTest-546590517 None] Created reservations ['745b8154-319d-4723-a760-2f7ac70a2fbd', '86642961-c995-489a-acf5-d8c97c5c5f55', '9f763985-0bdc-421f-8d28-bc148b9196b1', '527c7696-4b47-42d0-a16f-2f8dce5dd6b8'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8fda16a6-5004-4901-a401-998366241ef9 tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8fda16a6-5004-4901-a401-998366241ef9 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8fda16a6-5004-4901-a401-998366241ef9 tempest-CreateVolumesFromSnapshotTest-546590517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8fda16a6-5004-4901-a401-998366241ef9 tempest-CreateVolumesFromSnapshotTest-546590517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8fda16a6-5004-4901-a401-998366241ef9 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8fda16a6-5004-4901-a401-998366241ef9 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:51 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:07:51 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:51 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4f819ef8-0088-45b5-9dbd-da3650372078 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16" returned: 0 in 0.653s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4f819ef8-0088-45b5-9dbd-da3650372078 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16" released by "delete_volume" :: held 1.559s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-4f819ef8-0088-45b5-9dbd-da3650372078 tempest-VolumesSnapshotTestJSON-1501817216 None] Created reservations ['6a823980-36c2-4c72-acee-66b411740667', '19355859-2b83-4374-9eec-66ecaa0ea14c', 'a9c5d664-384c-43e1-8778-17925f463f54', '33bbb2e0-a61f-4abc-82b5-4ec41fd72d90'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:07:51 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD" returned: 1 in 0.741s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9cdef5-8e05-46fb-9ed0-6174863a9a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb51991c7164da494f4ba545400cc2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:48Z,use_quota=True,user_id='6566eacabf2346e4ae10519d81c917c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Creating volume be9cdef5-8e05-46fb-9ed0-6174863a9a98 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:07:51 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:51 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 1073741824 Jun 03 12:07:51 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4f819ef8-0088-45b5-9dbd-da3650372078 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4f819ef8-0088-45b5-9dbd-da3650372078 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4f819ef8-0088-45b5-9dbd-da3650372078 tempest-VolumesSnapshotTestJSON-1501817216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4f819ef8-0088-45b5-9dbd-da3650372078 tempest-VolumesSnapshotTestJSON-1501817216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4f819ef8-0088-45b5-9dbd-da3650372078 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4f819ef8-0088-45b5-9dbd-da3650372078 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:51 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:07:51 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-dd156ec0-a300-4cec-8636-6f2caf9d533a tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "cinder-9327bac6-cd1e-4e9f-a7bc-05f305012798-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-dd156ec0-a300-4cec-8636-6f2caf9d533a tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-9327bac6-cd1e-4e9f-a7bc-05f305012798-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-dd156ec0-a300-4cec-8636-6f2caf9d533a tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "cinder-quobyte-9327bac6-cd1e-4e9f-a7bc-05f305012798" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-dd156ec0-a300-4cec-8636-6f2caf9d533a tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-quobyte-9327bac6-cd1e-4e9f-a7bc-05f305012798" acquired by "delete_volume" :: waited 0.038s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:52 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8fda16a6-5004-4901-a401-998366241ef9 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.756s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-8fda16a6-5004-4901-a401-998366241ef9 tempest-CreateVolumesFromSnapshotTest-546590517 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3510c2a8-56a0-48b4-9ae6-609cfdfdea25]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dd156ec0-a300-4cec-8636-6f2caf9d533a tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9327bac6-cd1e-4e9f-a7bc-05f305012798 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:52 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-8fda16a6-5004-4901-a401-998366241ef9 tempest-CreateVolumesFromSnapshotTest-546590517 None] Deleted volume successfully. Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-8fda16a6-5004-4901-a401-998366241ef9 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-9cc5a2cd-e686-435e-aa76-ce57265d60c5-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-41eb1936-1501-4f7d-8d6b-5080b8cc5380-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-41eb1936-1501-4f7d-8d6b-5080b8cc5380-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-quobyte-f50a8d17-b065-4fee-a93e-9acbffa6c981" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-f50a8d17-b065-4fee-a93e-9acbffa6c981" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-quobyte-41eb1936-1501-4f7d-8d6b-5080b8cc5380" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-41eb1936-1501-4f7d-8d6b-5080b8cc5380" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] Deleting offline snapshot 41eb1936-1501-4f7d-8d6b-5080b8cc5380 of volume f50a8d17-b065-4fee-a93e-9acbffa6c981 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] snapshot_file for this snap is: volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2170b76-10dc-47da-8f7c-cf718aef2d13]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:52 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9327bac6-cd1e-4e9f-a7bc-05f305012798 Jun 03 12:07:52 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:52 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380 Jun 03 12:07:52 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:52 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4f819ef8-0088-45b5-9dbd-da3650372078 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.800s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-4f819ef8-0088-45b5-9dbd-da3650372078 tempest-VolumesSnapshotTestJSON-1501817216 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:07:52 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-4f819ef8-0088-45b5-9dbd-da3650372078 tempest-VolumesSnapshotTestJSON-1501817216 None] Deleted volume successfully. Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4f819ef8-0088-45b5-9dbd-da3650372078 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-90600fe4-cecc-4b50-a5dd-ab73c0f4ee16-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:52 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 1073741824" returned: 0 in 0.925s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:52 devstack sudo[103133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 Jun 03 12:07:52 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:53 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dd156ec0-a300-4cec-8636-6f2caf9d533a tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9327bac6-cd1e-4e9f-a7bc-05f305012798" returned: 0 in 0.866s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dd156ec0-a300-4cec-8636-6f2caf9d533a tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9327bac6-cd1e-4e9f-a7bc-05f305012798 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:53 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9327bac6-cd1e-4e9f-a7bc-05f305012798 Jun 03 12:07:53 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:53 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380" returned: 0 in 0.776s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:53 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f50a8d17-b065-4fee-a93e-9acbffa6c981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:07:53 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[733f11a8-bd51-4869-bb98-297dbe1859f8]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:53 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98" returned: 0 in 0.671s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:53 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:07:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:53 devstack sudo[103144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 Jun 03 12:07:53 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:53 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Attempting download of 0c9449e8-19a7-462a-8b9a-7869ad3d8ed9 ((None, [{'url': 'file:///opt/stack/data/glance/images/0c9449e8-19a7-462a-8b9a-7869ad3d8ed9', 'metadata': {}}])) to volume be9cdef5-8e05-46fb-9ed0-6174863a9a98. {{(pid=86724) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 03 12:07:53 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[338478b7-c730-4346-97d8-b86a4675dbf8]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_dmtt9gsm {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:53 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_dmtt9gsm Jun 03 12:07:53 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:53 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dd156ec0-a300-4cec-8636-6f2caf9d533a tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-9327bac6-cd1e-4e9f-a7bc-05f305012798" returned: 0 in 0.632s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:53 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-dd156ec0-a300-4cec-8636-6f2caf9d533a tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-quobyte-9327bac6-cd1e-4e9f-a7bc-05f305012798" released by "delete_volume" :: held 1.565s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:53 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-dd156ec0-a300-4cec-8636-6f2caf9d533a tempest-CreateVolumesFromSnapshotTest-546590517 None] Created reservations ['9f88aa38-35c9-436e-82d4-6b016b50a530', 'f8735db8-7ad0-4bf7-995b-61409dcb89b2', '873d57fd-316d-486a-ae83-0f6c3de24660', '0eaf3185-8d1b-42f6-b5a7-46f7ab2726c7'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:07:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dd156ec0-a300-4cec-8636-6f2caf9d533a tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dd156ec0-a300-4cec-8636-6f2caf9d533a tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:53 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-dd156ec0-a300-4cec-8636-6f2caf9d533a tempest-CreateVolumesFromSnapshotTest-546590517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:53 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-dd156ec0-a300-4cec-8636-6f2caf9d533a tempest-CreateVolumesFromSnapshotTest-546590517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dd156ec0-a300-4cec-8636-6f2caf9d533a tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dd156ec0-a300-4cec-8636-6f2caf9d533a tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:53 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:07:53 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:54 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981" returned: 0 in 0.820s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:54 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380 Jun 03 12:07:54 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:54 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_dmtt9gsm" returned: 0 in 0.769s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_dmtt9gsm {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "cinder-7702fa9e-67a6-4e1d-8713-4287f785fcb1-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:54 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_dmtt9gsm Jun 03 12:07:54 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-7702fa9e-67a6-4e1d-8713-4287f785fcb1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "cinder-quobyte-6a9aefd2-209a-4db2-81c9-dc62b75a672e" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-quobyte-6a9aefd2-209a-4db2-81c9-dc62b75a672e" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "cinder-quobyte-7702fa9e-67a6-4e1d-8713-4287f785fcb1" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-quobyte-7702fa9e-67a6-4e1d-8713-4287f785fcb1" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:54 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] Deleting offline snapshot 7702fa9e-67a6-4e1d-8713-4287f785fcb1 of volume 6a9aefd2-209a-4db2-81c9-dc62b75a672e {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 12:07:54 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:54 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] snapshot_file for this snap is: volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.7702fa9e-67a6-4e1d-8713-4287f785fcb1 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 12:07:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dd156ec0-a300-4cec-8636-6f2caf9d533a tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.666s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:54 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-dd156ec0-a300-4cec-8636-6f2caf9d533a tempest-CreateVolumesFromSnapshotTest-546590517 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:07:54 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a60472-b197-4ca1-bd7c-48450f5f98d4]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.7702fa9e-67a6-4e1d-8713-4287f785fcb1 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:54 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-dd156ec0-a300-4cec-8636-6f2caf9d533a tempest-CreateVolumesFromSnapshotTest-546590517 None] Deleted volume successfully. Jun 03 12:07:54 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-dd156ec0-a300-4cec-8636-6f2caf9d533a tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-9327bac6-cd1e-4e9f-a7bc-05f305012798-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:54 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.7702fa9e-67a6-4e1d-8713-4287f785fcb1 Jun 03 12:07:54 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:54 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380" returned: 0 in 0.830s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:54 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380 Jun 03 12:07:54 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:55 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_dmtt9gsm" returned: 1 in 0.763s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_dmtt9gsm' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:07:55 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c764769a-9db4-4849-9752-be969c649ff1]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:55 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD Jun 03 12:07:55 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:55 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.7702fa9e-67a6-4e1d-8713-4287f785fcb1" returned: 0 in 0.768s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:55 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:07:55 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3124d9a8-cbbb-4502-ba0c-7d7bdb286596]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:55 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e Jun 03 12:07:55 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:55 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981.41eb1936-1501-4f7d-8d6b-5080b8cc5380" returned: 0 in 0.626s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:55 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-41eb1936-1501-4f7d-8d6b-5080b8cc5380" released by "_delete_snapshot" :: held 3.203s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:55 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-f50a8d17-b065-4fee-a93e-9acbffa6c981" released by "delete_snapshot" :: held 3.229s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:55 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] Created reservations ['4c7093b5-86fd-438f-a89d-673168378922', '7b3ba8e8-8337-4996-926a-3fddd5b0b739', '9f551734-ff8b-4902-b317-084712652ff3', '3d66e94e-16ca-4961-8e18-50eccf7d79bf'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:07:55 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] Delete snapshot completed successfully. Jun 03 12:07:55 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a8bf0f98-75a4-40b5-9150-34b589482f37 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-41eb1936-1501-4f7d-8d6b-5080b8cc5380-delete_snapshot" released by "delete_snapshot" :: held 3.382s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:55 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD" returned: 0 in 0.733s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:55 devstack sudo[103181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD Jun 03 12:07:55 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:56 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e" returned: 0 in 0.736s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.7702fa9e-67a6-4e1d-8713-4287f785fcb1 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:56 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.7702fa9e-67a6-4e1d-8713-4287f785fcb1 Jun 03 12:07:56 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:56 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD" returned: 1 in 0.676s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:07:56 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] 0c9449e8-19a7-462a-8b9a-7869ad3d8ed9 was raw, converting to raw {{(pid=86724) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 03 12:07:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:56 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 Jun 03 12:07:56 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b42c72fa-d3e3-4136-8aa1-94d2b56b3034 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-f50a8d17-b065-4fee-a93e-9acbffa6c981-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b42c72fa-d3e3-4136-8aa1-94d2b56b3034 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-f50a8d17-b065-4fee-a93e-9acbffa6c981-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b42c72fa-d3e3-4136-8aa1-94d2b56b3034 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-quobyte-f50a8d17-b065-4fee-a93e-9acbffa6c981" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b42c72fa-d3e3-4136-8aa1-94d2b56b3034 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-f50a8d17-b065-4fee-a93e-9acbffa6c981" acquired by "delete_volume" :: waited 0.020s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:56 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f0a0ae-c798-47dc-980e-3fd9c4a0f8c5]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b42c72fa-d3e3-4136-8aa1-94d2b56b3034 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:56 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.7702fa9e-67a6-4e1d-8713-4287f785fcb1" returned: 0 in 0.813s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.7702fa9e-67a6-4e1d-8713-4287f785fcb1 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:56 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.7702fa9e-67a6-4e1d-8713-4287f785fcb1 Jun 03 12:07:56 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:56 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 Jun 03 12:07:56 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:57 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98" returned: 0 in 0.723s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:57 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0c9449e8-19a7-462a-8b9a-7869ad3d8ed9_52p5t85udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 12:07:57 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Converted 0.00 MB image at 0.00 MB/s Jun 03 12:07:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:57 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 1G Jun 03 12:07:57 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:57 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e.7702fa9e-67a6-4e1d-8713-4287f785fcb1" returned: 0 in 0.615s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:57 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-quobyte-7702fa9e-67a6-4e1d-8713-4287f785fcb1" released by "_delete_snapshot" :: held 3.059s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:57 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-quobyte-6a9aefd2-209a-4db2-81c9-dc62b75a672e" released by "delete_snapshot" :: held 3.115s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:57 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b42c72fa-d3e3-4136-8aa1-94d2b56b3034 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981" returned: 0 in 0.747s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b42c72fa-d3e3-4136-8aa1-94d2b56b3034 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:57 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981 Jun 03 12:07:57 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:57 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] Created reservations ['70f82ed2-74cd-4f9c-b9f1-1690091960e3', '4fdbe2f8-f8b2-4dff-b7c6-01f276eecfc2', 'c1777b18-4233-472c-a511-39aae0785ea4', '26ebb6b6-82f9-45fc-bad3-a9f9d796c4a1'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:07:57 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] Delete snapshot completed successfully. Jun 03 12:07:57 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5e263c42-1ef4-4463-a34e-9c94434ad0a3 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-7702fa9e-67a6-4e1d-8713-4287f785fcb1-delete_snapshot" released by "delete_snapshot" :: held 3.334s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:57 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 1G" returned: 0 in 0.705s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:57 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22a3e6d-35cc-46d0-a65a-965372bb49da]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:58 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 Jun 03 12:07:58 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:58 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b42c72fa-d3e3-4136-8aa1-94d2b56b3034 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f50a8d17-b065-4fee-a93e-9acbffa6c981" returned: 0 in 0.649s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:58 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b42c72fa-d3e3-4136-8aa1-94d2b56b3034 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-f50a8d17-b065-4fee-a93e-9acbffa6c981" released by "delete_volume" :: held 1.455s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:58 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-b42c72fa-d3e3-4136-8aa1-94d2b56b3034 tempest-VolumesSnapshotTestJSON-1501817216 None] Created reservations ['74b769f4-bee0-4c74-8c5e-0a7c1b6925df', '0238a084-fed0-44fb-ae9e-54aff5f8b182', 'aedbf537-8053-47cb-a5e2-c7a7f0cf8b77', 'd4ca6856-934b-4947-93ed-c3641ca3b514'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:07:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b42c72fa-d3e3-4136-8aa1-94d2b56b3034 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b42c72fa-d3e3-4136-8aa1-94d2b56b3034 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:58 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b42c72fa-d3e3-4136-8aa1-94d2b56b3034 tempest-VolumesSnapshotTestJSON-1501817216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:58 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b42c72fa-d3e3-4136-8aa1-94d2b56b3034 tempest-VolumesSnapshotTestJSON-1501817216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b42c72fa-d3e3-4136-8aa1-94d2b56b3034 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b42c72fa-d3e3-4136-8aa1-94d2b56b3034 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:58 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:07:58 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:58 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-6dc52904-9cc7-4e4a-b446-bdb6180d9079 tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "cinder-6a9aefd2-209a-4db2-81c9-dc62b75a672e-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:58 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98" returned: 0 in 0.749s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:58 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-6dc52904-9cc7-4e4a-b446-bdb6180d9079 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-6a9aefd2-209a-4db2-81c9-dc62b75a672e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:58 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-6dc52904-9cc7-4e4a-b446-bdb6180d9079 tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "cinder-quobyte-6a9aefd2-209a-4db2-81c9-dc62b75a672e" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:07:58 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-6dc52904-9cc7-4e4a-b446-bdb6180d9079 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-quobyte-6a9aefd2-209a-4db2-81c9-dc62b75a672e" acquired by "delete_volume" :: waited 0.024s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:07:58 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[825e6162-9f82-4b0c-aefe-56ae9ec2a618]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:07:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6dc52904-9cc7-4e4a-b446-bdb6180d9079 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:58 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 Jun 03 12:07:58 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:58 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e Jun 03 12:07:58 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:59 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b42c72fa-d3e3-4136-8aa1-94d2b56b3034 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.678s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-b42c72fa-d3e3-4136-8aa1-94d2b56b3034 tempest-VolumesSnapshotTestJSON-1501817216 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:07:59 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-b42c72fa-d3e3-4136-8aa1-94d2b56b3034 tempest-VolumesSnapshotTestJSON-1501817216 None] Deleted volume successfully. Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b42c72fa-d3e3-4136-8aa1-94d2b56b3034 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-f50a8d17-b065-4fee-a93e-9acbffa6c981-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:07:59 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Flow 'volume_create_manager' (75398293-0f87-4b43-8e5d-071f684899c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2d5da0-e154-4ae8-9267-93bbe4ce903c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98" returned: 1 in 0.870s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Downloaded image 0c9449e8-19a7-462a-8b9a-7869ad3d8ed9 ((None, [{'url': 'file:///opt/stack/data/glance/images/0c9449e8-19a7-462a-8b9a-7869ad3d8ed9', 'metadata': {}}])) to volume be9cdef5-8e05-46fb-9ed0-6174863a9a98 successfully. {{(pid=86724) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Temporary image 0c9449e8-19a7-462a-8b9a-7869ad3d8ed9 for user 6566eacabf2346e4ae10519d81c917c8 is deleted. {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Marking volume be9cdef5-8e05-46fb-9ed0-6174863a9a98 as bootable. {{(pid=86724) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2d5da0-e154-4ae8-9267-93bbe4ce903c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-646746660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16bd0b53-ec02-461b-959d-4e7108820e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c3129e0c0b4264aa94af3e6181eff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:59Z,use_quota=True,user_id='69cbc18134214d10a7785e1dda1a6eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f90276f-4a16-4d0f-b61c-6d950d453851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f90276f-4a16-4d0f-b61c-6d950d453851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4bc22d2-0f73-4fb9-89f0-6f23f4a519a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4bc22d2-0f73-4fb9-89f0-6f23f4a519a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16bd0b53-ec02-461b-959d-4e7108820e38', 'volume_name': 'volume-16bd0b53-ec02-461b-959d-4e7108820e38', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96070fe9-11df-4222-bae2-5fc078cb5741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96070fe9-11df-4222-bae2-5fc078cb5741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ecc770a-decd-40cb-a6be-06f85be16774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:59 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Volume 16bd0b53-ec02-461b-959d-4e7108820e38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16bd0b53-ec02-461b-959d-4e7108820e38', 'volume_size': 1} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-646746660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16bd0b53-ec02-461b-959d-4e7108820e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c3129e0c0b4264aa94af3e6181eff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:07:59Z,use_quota=True,user_id='69cbc18134214d10a7785e1dda1a6eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Creating volume 16bd0b53-ec02-461b-959d-4e7108820e38 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:07:59 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Copying metadata from image 0c9449e8-19a7-462a-8b9a-7869ad3d8ed9 to be9cdef5-8e05-46fb-9ed0-6174863a9a98. {{(pid=86724) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Creating volume glance metadata for volume be9cdef5-8e05-46fb-9ed0-6174863a9a98 backed by image 0c9449e8-19a7-462a-8b9a-7869ad3d8ed9 with: {'image_id': '0c9449e8-19a7-462a-8b9a-7869ad3d8ed9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'de34eefad489a1d1bff7fcd5df8ef54a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86724) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 03 12:07:59 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38 1073741824 Jun 03 12:07:59 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:59 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6dc52904-9cc7-4e4a-b446-bdb6180d9079 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e" returned: 0 in 0.875s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6dc52904-9cc7-4e4a-b446-bdb6180d9079 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:07:59 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e Jun 03 12:07:59 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2123837-fa07-4bd3-a7f1-1192c39fe356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98', 'volume_size': 1, 'image_id': '0c9449e8-19a7-462a-8b9a-7869ad3d8ed9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c9449e8-19a7-462a-8b9a-7869ad3d8ed9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'de34eefad489a1d1bff7fcd5df8ef54a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4eb51991c7164da494f4ba545400cc2d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5374aadd0f9c84d396062f6f06890296934408cab5615bc929db03201b79d520c6f555dac8e1b88485d55e06d51555a7170cb1aafe8c5ccf5135973c1d070859', 'id': '0c9449e8-19a7-462a-8b9a-7869ad3d8ed9', 'created_at': datetime.datetime(2026, 6, 3, 10, 7, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 10, 7, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c9449e8-19a7-462a-8b9a-7869ad3d8ed9/file', 'properties': {}}, 'image_service': }' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6a8a82-05e1-4490-9766-3ecfdb8b9188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:07:59 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Volume volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 (be9cdef5-8e05-46fb-9ed0-6174863a9a98): created successfully Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6a8a82-05e1-4490-9766-3ecfdb8b9188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:07:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Flow 'volume_create_manager' (7d50213a-373a-4be3-ad37-84c9426a0f6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:07:59 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-1e43a808-db5c-45f4-8289-f055f5948deb tempest-VolumeImageDependencyTests-524825489 None] Created volume successfully. Jun 03 12:08:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] Acquiring lock "cinder-be9cdef5-8e05-46fb-9ed0-6174863a9a98-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] Lock "cinder-be9cdef5-8e05-46fb-9ed0-6174863a9a98-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] Acquiring lock "cinder-quobyte-be9cdef5-8e05-46fb-9ed0-6174863a9a98" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] Lock "cinder-quobyte-be9cdef5-8e05-46fb-9ed0-6174863a9a98" acquired by "delete_volume" :: waited 0.019s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:00 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[656e3e12-0284-4e7d-a8d1-5ca6a6ef926e]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:00 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 Jun 03 12:08:00 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:00 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:00 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6dc52904-9cc7-4e4a-b446-bdb6180d9079 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6a9aefd2-209a-4db2-81c9-dc62b75a672e" returned: 0 in 0.863s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38 1073741824" returned: 0 in 0.931s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-6dc52904-9cc7-4e4a-b446-bdb6180d9079 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-quobyte-6a9aefd2-209a-4db2-81c9-dc62b75a672e" released by "delete_volume" :: held 1.803s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:00 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38 Jun 03 12:08:00 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:00 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-6dc52904-9cc7-4e4a-b446-bdb6180d9079 tempest-CreateVolumesFromSnapshotTest-546590517 None] Created reservations ['995e3499-0f28-45c2-87c7-9b1c32d6a739', 'a44398ff-e217-49a2-a984-6947cc08c9f4', '1a6223b5-736d-4c3e-a338-c8b2e433ac2b', '8edc443b-801d-4f7e-ab0d-b2285243dfb2'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:08:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6dc52904-9cc7-4e4a-b446-bdb6180d9079 tempest-CreateVolumesFromSnapshotTest-546590517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6dc52904-9cc7-4e4a-b446-bdb6180d9079 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-6dc52904-9cc7-4e4a-b446-bdb6180d9079 tempest-CreateVolumesFromSnapshotTest-546590517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:08:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-6dc52904-9cc7-4e4a-b446-bdb6180d9079 tempest-CreateVolumesFromSnapshotTest-546590517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:08:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6dc52904-9cc7-4e4a-b446-bdb6180d9079 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6dc52904-9cc7-4e4a-b446-bdb6180d9079 tempest-CreateVolumesFromSnapshotTest-546590517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:00 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:08:00 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:01 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98" returned: 0 in 0.807s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:01 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 Jun 03 12:08:01 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:01 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38" returned: 0 in 0.679s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:08:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ecc770a-decd-40cb-a6be-06f85be16774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16bd0b53-ec02-461b-959d-4e7108820e38', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbb06ad-9d3d-4e71-ade6-ad4e855c1bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:01 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Volume volume-16bd0b53-ec02-461b-959d-4e7108820e38 (16bd0b53-ec02-461b-959d-4e7108820e38): created successfully Jun 03 12:08:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbb06ad-9d3d-4e71-ade6-ad4e855c1bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Flow 'volume_create_manager' (75398293-0f87-4b43-8e5d-071f684899c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:08:01 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-00c31f48-deee-4560-ad59-20b5625862f4 tempest-VolumesSnapshotTestJSON-1501817216 None] Created volume successfully. Jun 03 12:08:01 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6dc52904-9cc7-4e4a-b446-bdb6180d9079 tempest-CreateVolumesFromSnapshotTest-546590517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.717s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:01 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-6dc52904-9cc7-4e4a-b446-bdb6180d9079 tempest-CreateVolumesFromSnapshotTest-546590517 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:08:01 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-6dc52904-9cc7-4e4a-b446-bdb6180d9079 tempest-CreateVolumesFromSnapshotTest-546590517 None] Deleted volume successfully. Jun 03 12:08:01 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-6dc52904-9cc7-4e4a-b446-bdb6180d9079 tempest-CreateVolumesFromSnapshotTest-546590517 None] Lock "cinder-6a9aefd2-209a-4db2-81c9-dc62b75a672e-delete_volume" released by "delete_volume" :: held 2.758s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d917170e-fe15-4291-a454-81066eceb1e9 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d917170e-fe15-4291-a454-81066eceb1e9 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-d917170e-fe15-4291-a454-81066eceb1e9 tempest-VolumesSnapshotTestJSON-1501817216 None] Creating offline snapshot 9067e4d3-7330-48e3-88b2-a4fb5bd2012b of volume 16bd0b53-ec02-461b-959d-4e7108820e38 {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 12:08:01 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f5462b-e9cc-49d5-8ae3-a67d55bd8a1e]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d917170e-fe15-4291-a454-81066eceb1e9 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:01 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98" returned: 1 in 0.853s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:08:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:01 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98 Jun 03 12:08:01 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:02 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38 Jun 03 12:08:02 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:02 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-be9cdef5-8e05-46fb-9ed0-6174863a9a98" returned: 0 in 0.647s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:02 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] Lock "cinder-quobyte-be9cdef5-8e05-46fb-9ed0-6174863a9a98" released by "delete_volume" :: held 2.384s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:02 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] Created reservations ['597821f5-8578-4a18-8403-5d7fdb41b699', 'd102c35e-d3ac-4d14-8a17-cf5cca1082f6', '8ab5e8ec-a5a0-49c8-868b-f855e2ce7e42', '711c4adf-0f53-4ddf-801c-4c74e7e3d9ce'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:08:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:02 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:08:02 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:08:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:02 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d917170e-fe15-4291-a454-81066eceb1e9 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38" returned: 0 in 0.836s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d917170e-fe15-4291-a454-81066eceb1e9 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:02 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:08:02 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:02 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b 1G Jun 03 12:08:02 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:03 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.694s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:03 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:08:03 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] Deleted volume successfully. Jun 03 12:08:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-f8e13ce3-df9a-45d2-a5bf-e44de8beed87 tempest-VolumeImageDependencyTests-524825489 None] Lock "cinder-be9cdef5-8e05-46fb-9ed0-6174863a9a98-delete_volume" released by "delete_volume" :: held 3.331s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:03 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d917170e-fe15-4291-a454-81066eceb1e9 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b 1G" returned: 0 in 0.874s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d917170e-fe15-4291-a454-81066eceb1e9 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16bd0b53-ec02-461b-959d-4e7108820e38 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:03 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16bd0b53-ec02-461b-959d-4e7108820e38 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b Jun 03 12:08:03 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:04 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d917170e-fe15-4291-a454-81066eceb1e9 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16bd0b53-ec02-461b-959d-4e7108820e38 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b" returned: 0 in 0.752s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:04 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-d917170e-fe15-4291-a454-81066eceb1e9 tempest-VolumesSnapshotTestJSON-1501817216 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b is being set with open permissions: ugo+rw Jun 03 12:08:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d917170e-fe15-4291-a454-81066eceb1e9 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:04 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b Jun 03 12:08:04 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:05 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d917170e-fe15-4291-a454-81066eceb1e9 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b" returned: 0 in 0.683s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d917170e-fe15-4291-a454-81066eceb1e9 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:05 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.info Jun 03 12:08:05 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:05 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d917170e-fe15-4291-a454-81066eceb1e9 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.info" returned: 0 in 0.686s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:05 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-d917170e-fe15-4291-a454-81066eceb1e9 tempest-VolumesSnapshotTestJSON-1501817216 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.info is being set with open permissions: ugo+rw Jun 03 12:08:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d917170e-fe15-4291-a454-81066eceb1e9 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:05 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.info Jun 03 12:08:05 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:06 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d917170e-fe15-4291-a454-81066eceb1e9 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.info" returned: 0 in 0.664s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d917170e-fe15-4291-a454-81066eceb1e9 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.607s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:06 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d917170e-fe15-4291-a454-81066eceb1e9 tempest-VolumesSnapshotTestJSON-1501817216 None] Create snapshot completed successfully Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Flow 'volume_create_manager' (e3dc5135-a30a-4549-a6f4-3be7abeb1009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb7d2d8-56c1-49e8-b46f-159b12f28937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb7d2d8-56c1-49e8-b46f-159b12f28937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2751f75b-1d9b-455e-a097-46ee871d93cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561f0f1a76d54c8cbf6ec4b9c9467df8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:08:07Z,use_quota=True,user_id='b057a3b00d584e97837c21b5e2f45523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db93e77d-11f9-4a3e-8999-8ae27766e0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db93e77d-11f9-4a3e-8999-8ae27766e0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949d2dcc-0b4d-4cac-8b82-973ce3f2f5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949d2dcc-0b4d-4cac-8b82-973ce3f2f5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2751f75b-1d9b-455e-a097-46ee871d93cc', 'volume_name': 'volume-2751f75b-1d9b-455e-a097-46ee871d93cc', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785d8049-e144-4c1a-b548-9a02c7da216b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785d8049-e144-4c1a-b548-9a02c7da216b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72ff933-a9e8-45eb-91fa-4c332b4b35ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:06 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Volume 2751f75b-1d9b-455e-a097-46ee871d93cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2751f75b-1d9b-455e-a097-46ee871d93cc', 'volume_size': 1} Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2751f75b-1d9b-455e-a097-46ee871d93cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561f0f1a76d54c8cbf6ec4b9c9467df8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:08:07Z,use_quota=True,user_id='b057a3b00d584e97837c21b5e2f45523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Creating volume 2751f75b-1d9b-455e-a097-46ee871d93cc {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:08:06 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:08:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2751f75b-1d9b-455e-a097-46ee871d93cc 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:06 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2751f75b-1d9b-455e-a097-46ee871d93cc 1073741824 Jun 03 12:08:06 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:07 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:08:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Flow 'volume_create_manager' (752e3390-248b-4988-a248-8f26a97bb50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:08:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4297a5-ea3c-4398-b668-3536f8088b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4297a5-ea3c-4398-b668-3536f8088b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1099398725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecaee915-44e7-4c7b-96c5-8178f7b4d234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c3129e0c0b4264aa94af3e6181eff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9067e4d3-7330-48e3-88b2-a4fb5bd2012b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:08:08Z,use_quota=True,user_id='69cbc18134214d10a7785e1dda1a6eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fa8e614-b3c1-4b45-b4fa-32e2be3618e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fa8e614-b3c1-4b45-b4fa-32e2be3618e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb4ab94-1047-4ddc-82f1-1646d3c83373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb4ab94-1047-4ddc-82f1-1646d3c83373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ecaee915-44e7-4c7b-96c5-8178f7b4d234', 'volume_name': 'volume-ecaee915-44e7-4c7b-96c5-8178f7b4d234', 'volume_size': 1, 'snapshot_id': '9067e4d3-7330-48e3-88b2-a4fb5bd2012b'}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347ce08c-d93d-46f0-923a-48afd82ec737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347ce08c-d93d-46f0-923a-48afd82ec737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d72c56a4-839e-4a45-8f82-180e14ee30b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:07 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Volume ecaee915-44e7-4c7b-96c5-8178f7b4d234: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ecaee915-44e7-4c7b-96c5-8178f7b4d234', 'volume_size': 1, 'snapshot_id': '9067e4d3-7330-48e3-88b2-a4fb5bd2012b'} Jun 03 12:08:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:07 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2751f75b-1d9b-455e-a097-46ee871d93cc 1073741824" returned: 0 in 0.995s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2751f75b-1d9b-455e-a097-46ee871d93cc {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:07 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2751f75b-1d9b-455e-a097-46ee871d93cc Jun 03 12:08:07 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:08 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2751f75b-1d9b-455e-a097-46ee871d93cc" returned: 0 in 0.603s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.703s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-quobyte-9067e4d3-7330-48e3-88b2-a4fb5bd2012b-ecaee915-44e7-4c7b-96c5-8178f7b4d234" by "_create_volume_from_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72ff933-a9e8-45eb-91fa-4c332b4b35ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2751f75b-1d9b-455e-a097-46ee871d93cc', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717130c8-a0fb-44cd-8205-e404b0a94962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-9067e4d3-7330-48e3-88b2-a4fb5bd2012b-ecaee915-44e7-4c7b-96c5-8178f7b4d234" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Creating volume ecaee915-44e7-4c7b-96c5-8178f7b4d234 from snapshot 9067e4d3-7330-48e3-88b2-a4fb5bd2012b {{(pid=86724) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-quobyte-ecaee915-44e7-4c7b-96c5-8178f7b4d234" by "_copy_volume_from_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:08 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Volume volume-2751f75b-1d9b-455e-a097-46ee871d93cc (2751f75b-1d9b-455e-a097-46ee871d93cc): created successfully Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717130c8-a0fb-44cd-8205-e404b0a94962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Flow 'volume_create_manager' (e3dc5135-a30a-4549-a6f4-3be7abeb1009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-ecaee915-44e7-4c7b-96c5-8178f7b4d234" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] snapshot: 9067e4d3-7330-48e3-88b2-a4fb5bd2012b, volume: ecaee915-44e7-4c7b-96c5-8178f7b4d234, {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 12:08:08 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-5b4efb25-0b9b-4ae1-a479-207e3b58f820 tempest-CinderUnicodeTest-2081806099 None] Created volume successfully. Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e979ac8-1a85-43ef-a080-401972fcdb3d]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:08 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b Jun 03 12:08:08 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:09 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:08:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Flow 'volume_create_manager' (2245a477-6e8c-4174-8a4e-1914851095bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:08:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6457b292-e77b-4540-870c-cb3fde63ca9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:09 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6457b292-e77b-4540-870c-cb3fde63ca9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:08:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1430895733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edf6c3a0-fd3d-44ad-815d-4da4cb8f2572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561f0f1a76d54c8cbf6ec4b9c9467df8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:08:09Z,use_quota=True,user_id='b057a3b00d584e97837c21b5e2f45523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b409823-a0b6-4901-b218-5185b5e2e426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b409823-a0b6-4901-b218-5185b5e2e426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d616c81-575e-49fe-a05f-b9bab799a7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d616c81-575e-49fe-a05f-b9bab799a7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edf6c3a0-fd3d-44ad-815d-4da4cb8f2572', 'volume_name': 'volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca953cdf-fcf3-4e9b-a602-2acfdee9193c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca953cdf-fcf3-4e9b-a602-2acfdee9193c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (333747a7-18b4-4718-bbc3-fd19aeda8e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:09 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Volume edf6c3a0-fd3d-44ad-815d-4da4cb8f2572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572', 'volume_size': 1} Jun 03 12:08:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b" returned: 0 in 0.953s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16bd0b53-ec02-461b-959d-4e7108820e38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:08:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] will copy from snapshot at /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38 {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 12:08:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Creating direct copy from snapshot {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 12:08:09 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3756852-42a8-40e5-aafa-569c4fa500ab]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:09 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38 Jun 03 12:08:09 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:10 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38" returned: 0 in 0.744s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:10 devstack cinder-volume[86724]: DEBUG cinder.utils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Path /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ecaee915-44e7-4c7b-96c5-8178f7b4d234 not found in is_blk_device check {{(pid=86724) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 03 12:08:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ecaee915-44e7-4c7b-96c5-8178f7b4d234 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:10 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ecaee915-44e7-4c7b-96c5-8178f7b4d234 Jun 03 12:08:10 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:15 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ecaee915-44e7-4c7b-96c5-8178f7b4d234" returned: 0 in 5.599s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:15 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2246ebfc-dde5-43d4-99a7-aecbb1e25c13]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:16 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38 Jun 03 12:08:16 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:16 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38" returned: 0 in 0.929s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:16 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Image conversion details: src /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ecaee915-44e7-4c7b-96c5-8178f7b4d234 {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 12:08:16 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Converted 1024.00 MB image at 182.82 MB/s Jun 03 12:08:16 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ecaee915-44e7-4c7b-96c5-8178f7b4d234 is being set with open permissions: ugo+rw Jun 03 12:08:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ecaee915-44e7-4c7b-96c5-8178f7b4d234 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:16 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ecaee915-44e7-4c7b-96c5-8178f7b4d234 Jun 03 12:08:16 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:17 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ecaee915-44e7-4c7b-96c5-8178f7b4d234" returned: 0 in 0.690s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:17 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-ecaee915-44e7-4c7b-96c5-8178f7b4d234" released by "_copy_volume_from_snapshot" :: held 9.064s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:17 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-9067e4d3-7330-48e3-88b2-a4fb5bd2012b-ecaee915-44e7-4c7b-96c5-8178f7b4d234" released by "_create_volume_from_snapshot" :: held 9.109s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.142s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.029s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:08:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1430895733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edf6c3a0-fd3d-44ad-815d-4da4cb8f2572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561f0f1a76d54c8cbf6ec4b9c9467df8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:08:09Z,use_quota=True,user_id='b057a3b00d584e97837c21b5e2f45523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:08:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Creating volume edf6c3a0-fd3d-44ad-815d-4da4cb8f2572 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:08:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:08:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:08:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:08:17 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:08:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:17 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572 1073741824 Jun 03 12:08:17 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d72c56a4-839e-4a45-8f82-180e14ee30b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecaee915-44e7-4c7b-96c5-8178f7b4d234', 'volume_size': 1, 'snapshot_id': '9067e4d3-7330-48e3-88b2-a4fb5bd2012b'}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9571a84-b612-4ca6-a494-28f306d8979e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:17 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Volume volume-ecaee915-44e7-4c7b-96c5-8178f7b4d234 (ecaee915-44e7-4c7b-96c5-8178f7b4d234): created successfully Jun 03 12:08:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9571a84-b612-4ca6-a494-28f306d8979e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Flow 'volume_create_manager' (752e3390-248b-4988-a248-8f26a97bb50f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:08:17 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c6419863-243c-4946-b614-e8004c366989 tempest-VolumesSnapshotTestJSON-1501817216 None] Created volume successfully. Jun 03 12:08:18 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572 1073741824" returned: 0 in 0.887s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:18 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572 Jun 03 12:08:18 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a906216e-e41b-4bc4-b4d8-257e704a0765 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-ecaee915-44e7-4c7b-96c5-8178f7b4d234-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a906216e-e41b-4bc4-b4d8-257e704a0765 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-ecaee915-44e7-4c7b-96c5-8178f7b4d234-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a906216e-e41b-4bc4-b4d8-257e704a0765 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-quobyte-ecaee915-44e7-4c7b-96c5-8178f7b4d234" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:18 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a906216e-e41b-4bc4-b4d8-257e704a0765 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-ecaee915-44e7-4c7b-96c5-8178f7b4d234" acquired by "delete_volume" :: waited 0.028s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:18 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ebf299-edb5-4082-849b-da1ff806bb77]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a906216e-e41b-4bc4-b4d8-257e704a0765 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ecaee915-44e7-4c7b-96c5-8178f7b4d234 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:19 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ecaee915-44e7-4c7b-96c5-8178f7b4d234 Jun 03 12:08:19 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:19 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572" returned: 0 in 0.717s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:08:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:19 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (333747a7-18b4-4718-bbc3-fd19aeda8e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:19 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f24c1c9-7e42-42b7-b44c-bce5cbb6f798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:19 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Volume volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572 (edf6c3a0-fd3d-44ad-815d-4da4cb8f2572): created successfully Jun 03 12:08:19 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f24c1c9-7e42-42b7-b44c-bce5cbb6f798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:19 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Flow 'volume_create_manager' (2245a477-6e8c-4174-8a4e-1914851095bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:08:19 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-2356e748-efa4-445e-8d7a-fdf2baaee7c1 tempest-CinderUnicodeTest-2081806099 None] Created volume successfully. Jun 03 12:08:19 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a906216e-e41b-4bc4-b4d8-257e704a0765 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ecaee915-44e7-4c7b-96c5-8178f7b4d234" returned: 0 in 0.804s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a906216e-e41b-4bc4-b4d8-257e704a0765 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ecaee915-44e7-4c7b-96c5-8178f7b4d234 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:19 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ecaee915-44e7-4c7b-96c5-8178f7b4d234 Jun 03 12:08:19 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:20 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a906216e-e41b-4bc4-b4d8-257e704a0765 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-ecaee915-44e7-4c7b-96c5-8178f7b4d234" returned: 0 in 0.657s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a906216e-e41b-4bc4-b4d8-257e704a0765 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-ecaee915-44e7-4c7b-96c5-8178f7b4d234" released by "delete_volume" :: held 1.511s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:20 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-a906216e-e41b-4bc4-b4d8-257e704a0765 tempest-VolumesSnapshotTestJSON-1501817216 None] Created reservations ['64974a54-aec9-4686-a861-1921e5344cb1', 'de658bb4-24b9-4764-9d7f-cfe9316f0375', '056541ee-d6dd-4fab-a1da-9ed611c59f5c', 'b5fcf37a-0886-4dd8-b659-67837138fa43'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:08:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a906216e-e41b-4bc4-b4d8-257e704a0765 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a906216e-e41b-4bc4-b4d8-257e704a0765 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a906216e-e41b-4bc4-b4d8-257e704a0765 tempest-VolumesSnapshotTestJSON-1501817216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:08:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a906216e-e41b-4bc4-b4d8-257e704a0765 tempest-VolumesSnapshotTestJSON-1501817216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:08:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a906216e-e41b-4bc4-b4d8-257e704a0765 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a906216e-e41b-4bc4-b4d8-257e704a0765 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:20 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:08:20 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-03a9f1a3-e49c-4f3f-9336-19141e63ff00 tempest-CinderUnicodeTest-2081806099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-03a9f1a3-e49c-4f3f-9336-19141e63ff00 tempest-CinderUnicodeTest-2081806099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-03a9f1a3-e49c-4f3f-9336-19141e63ff00 tempest-CinderUnicodeTest-2081806099 None] Creating offline snapshot c8a02c0b-6a6d-4ad2-b86c-c543841c6b29 of volume edf6c3a0-fd3d-44ad-815d-4da4cb8f2572 {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 12:08:20 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c4e2a5-cfb1-42cd-8b80-9dc267ee54df]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-03a9f1a3-e49c-4f3f-9336-19141e63ff00 tempest-CinderUnicodeTest-2081806099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:20 devstack sudo[103389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572 Jun 03 12:08:20 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:21 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-9067e4d3-7330-48e3-88b2-a4fb5bd2012b-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:21 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-9067e4d3-7330-48e3-88b2-a4fb5bd2012b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:21 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-quobyte-16bd0b53-ec02-461b-959d-4e7108820e38" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:21 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-16bd0b53-ec02-461b-959d-4e7108820e38" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:21 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-quobyte-9067e4d3-7330-48e3-88b2-a4fb5bd2012b" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:21 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-9067e4d3-7330-48e3-88b2-a4fb5bd2012b" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] Deleting offline snapshot 9067e4d3-7330-48e3-88b2-a4fb5bd2012b of volume 16bd0b53-ec02-461b-959d-4e7108820e38 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 12:08:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] snapshot_file for this snap is: volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 12:08:21 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8af40f-2e6e-49ed-88a7-0fe342466a1a]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:21 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a906216e-e41b-4bc4-b4d8-257e704a0765 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.895s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:21 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-a906216e-e41b-4bc4-b4d8-257e704a0765 tempest-VolumesSnapshotTestJSON-1501817216 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:08:21 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a906216e-e41b-4bc4-b4d8-257e704a0765 tempest-VolumesSnapshotTestJSON-1501817216 None] Deleted volume successfully. Jun 03 12:08:21 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a906216e-e41b-4bc4-b4d8-257e704a0765 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-ecaee915-44e7-4c7b-96c5-8178f7b4d234-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:21 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b Jun 03 12:08:21 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:21 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-03a9f1a3-e49c-4f3f-9336-19141e63ff00 tempest-CinderUnicodeTest-2081806099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572" returned: 0 in 1.029s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-03a9f1a3-e49c-4f3f-9336-19141e63ff00 tempest-CinderUnicodeTest-2081806099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.c8a02c0b-6a6d-4ad2-b86c-c543841c6b29 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:21 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.c8a02c0b-6a6d-4ad2-b86c-c543841c6b29 1G Jun 03 12:08:21 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:22 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b" returned: 0 in 0.870s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16bd0b53-ec02-461b-959d-4e7108820e38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:08:22 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e2cf51-9735-488a-963a-1904b8a3f182]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:22 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38 Jun 03 12:08:22 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:22 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-03a9f1a3-e49c-4f3f-9336-19141e63ff00 tempest-CinderUnicodeTest-2081806099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.c8a02c0b-6a6d-4ad2-b86c-c543841c6b29 1G" returned: 0 in 0.883s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-03a9f1a3-e49c-4f3f-9336-19141e63ff00 tempest-CinderUnicodeTest-2081806099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.c8a02c0b-6a6d-4ad2-b86c-c543841c6b29 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:22 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.c8a02c0b-6a6d-4ad2-b86c-c543841c6b29 Jun 03 12:08:22 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:23 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38" returned: 0 in 0.821s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:23 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b Jun 03 12:08:23 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:23 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-03a9f1a3-e49c-4f3f-9336-19141e63ff00 tempest-CinderUnicodeTest-2081806099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.c8a02c0b-6a6d-4ad2-b86c-c543841c6b29" returned: 0 in 0.744s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:23 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-03a9f1a3-e49c-4f3f-9336-19141e63ff00 tempest-CinderUnicodeTest-2081806099 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.c8a02c0b-6a6d-4ad2-b86c-c543841c6b29 is being set with open permissions: ugo+rw Jun 03 12:08:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-03a9f1a3-e49c-4f3f-9336-19141e63ff00 tempest-CinderUnicodeTest-2081806099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.c8a02c0b-6a6d-4ad2-b86c-c543841c6b29 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:23 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.c8a02c0b-6a6d-4ad2-b86c-c543841c6b29 Jun 03 12:08:23 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:23 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b" returned: 0 in 0.811s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:23 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b Jun 03 12:08:23 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-03a9f1a3-e49c-4f3f-9336-19141e63ff00 tempest-CinderUnicodeTest-2081806099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.c8a02c0b-6a6d-4ad2-b86c-c543841c6b29" returned: 0 in 0.705s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:24 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-03a9f1a3-e49c-4f3f-9336-19141e63ff00 tempest-CinderUnicodeTest-2081806099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:24 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.info Jun 03 12:08:24 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:24 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38.9067e4d3-7330-48e3-88b2-a4fb5bd2012b" returned: 0 in 0.691s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-9067e4d3-7330-48e3-88b2-a4fb5bd2012b" released by "_delete_snapshot" :: held 3.329s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-16bd0b53-ec02-461b-959d-4e7108820e38" released by "delete_snapshot" :: held 3.371s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:24 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] Created reservations ['38bd8a07-a480-4a4e-97ad-91a4c5ab7e21', '6a250483-c66f-4449-820c-5720cf021eff', '4acf97b6-b70c-467d-b447-5f84a5de9b54', '37fb0f2f-f8d4-421f-bfea-2b16be9daaf5'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:08:24 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] Delete snapshot completed successfully. Jun 03 12:08:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d764f0d8-bd45-4236-9e66-efafdf9819e3 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-9067e4d3-7330-48e3-88b2-a4fb5bd2012b-delete_snapshot" released by "delete_snapshot" :: held 3.553s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:24 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-03a9f1a3-e49c-4f3f-9336-19141e63ff00 tempest-CinderUnicodeTest-2081806099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.info" returned: 0 in 0.672s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:24 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-03a9f1a3-e49c-4f3f-9336-19141e63ff00 tempest-CinderUnicodeTest-2081806099 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.info is being set with open permissions: ugo+rw Jun 03 12:08:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-03a9f1a3-e49c-4f3f-9336-19141e63ff00 tempest-CinderUnicodeTest-2081806099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:24 devstack sudo[103434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.info Jun 03 12:08:24 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:25 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-03a9f1a3-e49c-4f3f-9336-19141e63ff00 tempest-CinderUnicodeTest-2081806099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.info" returned: 0 in 0.618s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-03a9f1a3-e49c-4f3f-9336-19141e63ff00 tempest-CinderUnicodeTest-2081806099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.781s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:25 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-03a9f1a3-e49c-4f3f-9336-19141e63ff00 tempest-CinderUnicodeTest-2081806099 None] Create snapshot completed successfully Jun 03 12:08:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c5131a57-02de-460e-a006-688cfa9e86ba tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-16bd0b53-ec02-461b-959d-4e7108820e38-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c5131a57-02de-460e-a006-688cfa9e86ba tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-16bd0b53-ec02-461b-959d-4e7108820e38-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c5131a57-02de-460e-a006-688cfa9e86ba tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-quobyte-16bd0b53-ec02-461b-959d-4e7108820e38" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c5131a57-02de-460e-a006-688cfa9e86ba tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-16bd0b53-ec02-461b-959d-4e7108820e38" acquired by "delete_volume" :: waited 0.027s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:25 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e321ee-0c24-4c1b-8cb7-80fe2465ea5f]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c5131a57-02de-460e-a006-688cfa9e86ba tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] Acquiring lock "cinder-c8a02c0b-6a6d-4ad2-b86c-c543841c6b29-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:26 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38 Jun 03 12:08:26 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] Lock "cinder-c8a02c0b-6a6d-4ad2-b86c-c543841c6b29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] Acquiring lock "cinder-quobyte-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] Lock "cinder-quobyte-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] Acquiring lock "cinder-quobyte-c8a02c0b-6a6d-4ad2-b86c-c543841c6b29" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] Lock "cinder-quobyte-c8a02c0b-6a6d-4ad2-b86c-c543841c6b29" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:26 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] Deleting offline snapshot c8a02c0b-6a6d-4ad2-b86c-c543841c6b29 of volume edf6c3a0-fd3d-44ad-815d-4da4cb8f2572 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 12:08:26 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] snapshot_file for this snap is: volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.c8a02c0b-6a6d-4ad2-b86c-c543841c6b29 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 12:08:26 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3fbe8e-d915-426c-b41a-817a1b7cb778]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.c8a02c0b-6a6d-4ad2-b86c-c543841c6b29 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:26 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.c8a02c0b-6a6d-4ad2-b86c-c543841c6b29 Jun 03 12:08:26 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:26 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c5131a57-02de-460e-a006-688cfa9e86ba tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38" returned: 0 in 0.952s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c5131a57-02de-460e-a006-688cfa9e86ba tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:26 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38 Jun 03 12:08:26 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:27 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.c8a02c0b-6a6d-4ad2-b86c-c543841c6b29" returned: 0 in 0.896s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ead452-0945-4fe0-922c-6f4a44552f1d]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:27 devstack sudo[103449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572 Jun 03 12:08:27 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:27 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c5131a57-02de-460e-a006-688cfa9e86ba tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-16bd0b53-ec02-461b-959d-4e7108820e38" returned: 0 in 0.624s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c5131a57-02de-460e-a006-688cfa9e86ba tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-16bd0b53-ec02-461b-959d-4e7108820e38" released by "delete_volume" :: held 1.674s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-c5131a57-02de-460e-a006-688cfa9e86ba tempest-VolumesSnapshotTestJSON-1501817216 None] Created reservations ['e86224ad-9b1b-4fcf-aec9-7b6093db276f', 'b79bf776-e7c7-41cb-92c5-d013dfba8995', '2b5bb9c5-2bdb-4b0c-ac4f-87fb7c24fbf7', '727ad7c6-68ff-48f0-b9af-4f238aae1687'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Flow 'volume_create_manager' (ea635d2e-42f5-47fb-9fae-9471ef24890a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f039c7-103e-422b-a01c-0c930f362846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f039c7-103e-422b-a01c-0c930f362846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1905659492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252ebd22-02fd-427b-a9be-a37e4617c00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0efb8d107d8495f8e4abd770fd7ff5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:08:28Z,use_quota=True,user_id='43a38e71c54146caaccbfba8f5cb5e60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744b4a1f-e4c1-42ef-993b-299052425da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744b4a1f-e4c1-42ef-993b-299052425da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed98521-3289-4183-b33f-78f028413ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed98521-3289-4183-b33f-78f028413ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '252ebd22-02fd-427b-a9be-a37e4617c00f', 'volume_name': 'volume-252ebd22-02fd-427b-a9be-a37e4617c00f', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6899519c-2e50-4f51-9fdf-888feb9e16a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6899519c-2e50-4f51-9fdf-888feb9e16a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e487cc-a00d-41c1-b08a-41cc488ad9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:27 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Volume 252ebd22-02fd-427b-a9be-a37e4617c00f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-252ebd22-02fd-427b-a9be-a37e4617c00f', 'volume_size': 1} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1905659492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252ebd22-02fd-427b-a9be-a37e4617c00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0efb8d107d8495f8e4abd770fd7ff5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:08:28Z,use_quota=True,user_id='43a38e71c54146caaccbfba8f5cb5e60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Creating volume 252ebd22-02fd-427b-a9be-a37e4617c00f {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:08:27 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c5131a57-02de-460e-a006-688cfa9e86ba tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c5131a57-02de-460e-a006-688cfa9e86ba tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c5131a57-02de-460e-a006-688cfa9e86ba tempest-VolumesSnapshotTestJSON-1501817216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:08:27 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f 1073741824 Jun 03 12:08:27 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c5131a57-02de-460e-a006-688cfa9e86ba tempest-VolumesSnapshotTestJSON-1501817216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c5131a57-02de-460e-a006-688cfa9e86ba tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c5131a57-02de-460e-a006-688cfa9e86ba tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:27 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:08:27 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:27 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572" returned: 0 in 0.801s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.c8a02c0b-6a6d-4ad2-b86c-c543841c6b29 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:27 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.c8a02c0b-6a6d-4ad2-b86c-c543841c6b29 Jun 03 12:08:27 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:28 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-aa4682d8-e212-4fd6-8af1-c21a010cdda7 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-75d7544d-3e1a-485b-9f31-ae2f5f4cc673-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:28 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-aa4682d8-e212-4fd6-8af1-c21a010cdda7 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-75d7544d-3e1a-485b-9f31-ae2f5f4cc673-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:28 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-aa4682d8-e212-4fd6-8af1-c21a010cdda7 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "cinder-quobyte-75d7544d-3e1a-485b-9f31-ae2f5f4cc673" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:28 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-aa4682d8-e212-4fd6-8af1-c21a010cdda7 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-75d7544d-3e1a-485b-9f31-ae2f5f4cc673" acquired by "delete_volume" :: waited 0.029s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:28 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fcdd7d-0b34-40b0-9810-5bda6b606dfc]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa4682d8-e212-4fd6-8af1-c21a010cdda7 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:28 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673 Jun 03 12:08:28 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:28 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c5131a57-02de-460e-a006-688cfa9e86ba tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.707s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:28 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-c5131a57-02de-460e-a006-688cfa9e86ba tempest-VolumesSnapshotTestJSON-1501817216 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:08:28 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c5131a57-02de-460e-a006-688cfa9e86ba tempest-VolumesSnapshotTestJSON-1501817216 None] Deleted volume successfully. Jun 03 12:08:28 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c5131a57-02de-460e-a006-688cfa9e86ba tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-16bd0b53-ec02-461b-959d-4e7108820e38-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:28 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f 1073741824" returned: 0 in 0.880s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:28 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f Jun 03 12:08:28 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:28 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.c8a02c0b-6a6d-4ad2-b86c-c543841c6b29" returned: 0 in 0.878s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.c8a02c0b-6a6d-4ad2-b86c-c543841c6b29 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:28 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.c8a02c0b-6a6d-4ad2-b86c-c543841c6b29 Jun 03 12:08:28 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:29 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa4682d8-e212-4fd6-8af1-c21a010cdda7 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673" returned: 0 in 0.787s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa4682d8-e212-4fd6-8af1-c21a010cdda7 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:29 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673 Jun 03 12:08:29 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:29 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f" returned: 0 in 0.644s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e487cc-a00d-41c1-b08a-41cc488ad9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-252ebd22-02fd-427b-a9be-a37e4617c00f', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447cd4a8-9a41-4cd7-870b-97616a3a1519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:29 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Volume volume-252ebd22-02fd-427b-a9be-a37e4617c00f (252ebd22-02fd-427b-a9be-a37e4617c00f): created successfully Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447cd4a8-9a41-4cd7-870b-97616a3a1519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Flow 'volume_create_manager' (ea635d2e-42f5-47fb-9fae-9471ef24890a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:08:29 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-e50ed58b-46ae-458d-b88c-764f7dbf995b tempest-SnapshotDependencyTests-975463722 None] Created volume successfully. Jun 03 12:08:29 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572.c8a02c0b-6a6d-4ad2-b86c-c543841c6b29" returned: 0 in 0.673s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] Lock "cinder-quobyte-c8a02c0b-6a6d-4ad2-b86c-c543841c6b29" released by "_delete_snapshot" :: held 3.373s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] Lock "cinder-quobyte-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572" released by "delete_snapshot" :: held 3.399s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] Created reservations ['0e9bb7ad-08df-4a1f-8433-5fd4f9d8ef71', '1d236879-21f8-4d29-8212-eeed6e4738cf', '8b7f6d06-633e-4037-a319-ca02f8da0538', 'ac33e5f3-738e-4bc4-9572-0e39aaa6c98a'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:08:29 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] Delete snapshot completed successfully. Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0c8bce23-59ef-42d9-83c9-5b6ba6864305 tempest-CinderUnicodeTest-2081806099 None] Lock "cinder-c8a02c0b-6a6d-4ad2-b86c-c543841c6b29-delete_snapshot" released by "delete_snapshot" :: held 3.543s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:29 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa4682d8-e212-4fd6-8af1-c21a010cdda7 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-75d7544d-3e1a-485b-9f31-ae2f5f4cc673" returned: 0 in 0.689s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-aa4682d8-e212-4fd6-8af1-c21a010cdda7 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-quobyte-75d7544d-3e1a-485b-9f31-ae2f5f4cc673" released by "delete_volume" :: held 1.559s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-aa4682d8-e212-4fd6-8af1-c21a010cdda7 tempest-VolumesSnapshotTestJSON-1501817216 None] Created reservations ['5ccbbc59-e8a6-4ed7-8b5a-4b1b179ac8dd', '8165679e-f80e-4a51-9b20-e716805ad95e', 'f942be92-321a-4d15-9893-d4ee6637a247', 'a5c5bda2-cf26-49ff-89a4-d691e3438ec0'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-aa4682d8-e212-4fd6-8af1-c21a010cdda7 tempest-VolumesSnapshotTestJSON-1501817216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-aa4682d8-e212-4fd6-8af1-c21a010cdda7 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-aa4682d8-e212-4fd6-8af1-c21a010cdda7 tempest-VolumesSnapshotTestJSON-1501817216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-aa4682d8-e212-4fd6-8af1-c21a010cdda7 tempest-VolumesSnapshotTestJSON-1501817216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-aa4682d8-e212-4fd6-8af1-c21a010cdda7 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa4682d8-e212-4fd6-8af1-c21a010cdda7 tempest-VolumesSnapshotTestJSON-1501817216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:29 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:08:29 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-aa7a4e0e-029c-4590-9c8f-da327649f04f tempest-SnapshotDependencyTests-975463722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-aa7a4e0e-029c-4590-9c8f-da327649f04f tempest-SnapshotDependencyTests-975463722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-aa7a4e0e-029c-4590-9c8f-da327649f04f tempest-SnapshotDependencyTests-975463722 None] Creating offline snapshot 394f3c37-dd1c-47e5-af88-6127d3a5afd6 of volume 252ebd22-02fd-427b-a9be-a37e4617c00f {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e32b182-6fe5-4493-a23c-3832723850e0]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa7a4e0e-029c-4590-9c8f-da327649f04f tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:30 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f Jun 03 12:08:30 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d50a4915-1205-4181-b8a2-7afbc1a722ad tempest-CinderUnicodeTest-2081806099 None] Acquiring lock "cinder-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d50a4915-1205-4181-b8a2-7afbc1a722ad tempest-CinderUnicodeTest-2081806099 None] Lock "cinder-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d50a4915-1205-4181-b8a2-7afbc1a722ad tempest-CinderUnicodeTest-2081806099 None] Acquiring lock "cinder-quobyte-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d50a4915-1205-4181-b8a2-7afbc1a722ad tempest-CinderUnicodeTest-2081806099 None] Lock "cinder-quobyte-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572" acquired by "delete_volume" :: waited 0.021s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:30 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62235c0-e852-44b8-a936-5290643841c0]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d50a4915-1205-4181-b8a2-7afbc1a722ad tempest-CinderUnicodeTest-2081806099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:30 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa4682d8-e212-4fd6-8af1-c21a010cdda7 tempest-VolumesSnapshotTestJSON-1501817216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.725s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:30 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-aa4682d8-e212-4fd6-8af1-c21a010cdda7 tempest-VolumesSnapshotTestJSON-1501817216 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:08:30 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-aa4682d8-e212-4fd6-8af1-c21a010cdda7 tempest-VolumesSnapshotTestJSON-1501817216 None] Deleted volume successfully. Jun 03 12:08:30 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572 Jun 03 12:08:30 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-aa4682d8-e212-4fd6-8af1-c21a010cdda7 tempest-VolumesSnapshotTestJSON-1501817216 None] Lock "cinder-75d7544d-3e1a-485b-9f31-ae2f5f4cc673-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:30 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa7a4e0e-029c-4590-9c8f-da327649f04f tempest-SnapshotDependencyTests-975463722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f" returned: 0 in 0.894s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa7a4e0e-029c-4590-9c8f-da327649f04f tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:30 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6 1G Jun 03 12:08:30 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:31 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d50a4915-1205-4181-b8a2-7afbc1a722ad tempest-CinderUnicodeTest-2081806099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572" returned: 0 in 0.795s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d50a4915-1205-4181-b8a2-7afbc1a722ad tempest-CinderUnicodeTest-2081806099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:31 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572 Jun 03 12:08:31 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:31 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa7a4e0e-029c-4590-9c8f-da327649f04f tempest-SnapshotDependencyTests-975463722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6 1G" returned: 0 in 0.843s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa7a4e0e-029c-4590-9c8f-da327649f04f tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252ebd22-02fd-427b-a9be-a37e4617c00f -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:31 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252ebd22-02fd-427b-a9be-a37e4617c00f -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6 Jun 03 12:08:31 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:31 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d50a4915-1205-4181-b8a2-7afbc1a722ad tempest-CinderUnicodeTest-2081806099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572" returned: 0 in 0.719s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d50a4915-1205-4181-b8a2-7afbc1a722ad tempest-CinderUnicodeTest-2081806099 None] Lock "cinder-quobyte-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572" released by "delete_volume" :: held 1.603s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:32 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-d50a4915-1205-4181-b8a2-7afbc1a722ad tempest-CinderUnicodeTest-2081806099 None] Created reservations ['ccc1bde8-13d9-4c3d-bcc4-a3e6866b2c5c', '82988367-4e37-4770-a55a-a6d9a5e46664', '7ce4f361-74f9-444c-9483-4cfc05b569b5', '82e643f1-2658-4b73-8d60-4acb1c793457'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:08:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d50a4915-1205-4181-b8a2-7afbc1a722ad tempest-CinderUnicodeTest-2081806099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d50a4915-1205-4181-b8a2-7afbc1a722ad tempest-CinderUnicodeTest-2081806099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:32 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d50a4915-1205-4181-b8a2-7afbc1a722ad tempest-CinderUnicodeTest-2081806099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:08:32 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d50a4915-1205-4181-b8a2-7afbc1a722ad tempest-CinderUnicodeTest-2081806099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:08:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d50a4915-1205-4181-b8a2-7afbc1a722ad tempest-CinderUnicodeTest-2081806099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d50a4915-1205-4181-b8a2-7afbc1a722ad tempest-CinderUnicodeTest-2081806099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:32 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:08:32 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:32 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa7a4e0e-029c-4590-9c8f-da327649f04f tempest-SnapshotDependencyTests-975463722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252ebd22-02fd-427b-a9be-a37e4617c00f -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6" returned: 0 in 0.787s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:32 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-aa7a4e0e-029c-4590-9c8f-da327649f04f tempest-SnapshotDependencyTests-975463722 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6 is being set with open permissions: ugo+rw Jun 03 12:08:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa7a4e0e-029c-4590-9c8f-da327649f04f tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:32 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6 Jun 03 12:08:32 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-50e57dbd-2c68-4781-b740-bee5b43f3a53 tempest-CinderUnicodeTest-2081806099 None] Acquiring lock "cinder-2751f75b-1d9b-455e-a097-46ee871d93cc-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-50e57dbd-2c68-4781-b740-bee5b43f3a53 tempest-CinderUnicodeTest-2081806099 None] Lock "cinder-2751f75b-1d9b-455e-a097-46ee871d93cc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-50e57dbd-2c68-4781-b740-bee5b43f3a53 tempest-CinderUnicodeTest-2081806099 None] Acquiring lock "cinder-quobyte-2751f75b-1d9b-455e-a097-46ee871d93cc" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-50e57dbd-2c68-4781-b740-bee5b43f3a53 tempest-CinderUnicodeTest-2081806099 None] Lock "cinder-quobyte-2751f75b-1d9b-455e-a097-46ee871d93cc" acquired by "delete_volume" :: waited 0.018s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:32 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e907fc-c6b7-4145-9e3f-63120357a8cd]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-50e57dbd-2c68-4781-b740-bee5b43f3a53 tempest-CinderUnicodeTest-2081806099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2751f75b-1d9b-455e-a097-46ee871d93cc {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:32 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2751f75b-1d9b-455e-a097-46ee871d93cc Jun 03 12:08:32 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:32 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d50a4915-1205-4181-b8a2-7afbc1a722ad tempest-CinderUnicodeTest-2081806099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.735s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:32 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-d50a4915-1205-4181-b8a2-7afbc1a722ad tempest-CinderUnicodeTest-2081806099 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:08:32 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d50a4915-1205-4181-b8a2-7afbc1a722ad tempest-CinderUnicodeTest-2081806099 None] Deleted volume successfully. Jun 03 12:08:33 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d50a4915-1205-4181-b8a2-7afbc1a722ad tempest-CinderUnicodeTest-2081806099 None] Lock "cinder-edf6c3a0-fd3d-44ad-815d-4da4cb8f2572-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:33 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa7a4e0e-029c-4590-9c8f-da327649f04f tempest-SnapshotDependencyTests-975463722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6" returned: 0 in 0.772s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa7a4e0e-029c-4590-9c8f-da327649f04f tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:33 devstack sudo[103524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.info Jun 03 12:08:33 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:33 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-50e57dbd-2c68-4781-b740-bee5b43f3a53 tempest-CinderUnicodeTest-2081806099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2751f75b-1d9b-455e-a097-46ee871d93cc" returned: 0 in 0.983s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-50e57dbd-2c68-4781-b740-bee5b43f3a53 tempest-CinderUnicodeTest-2081806099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2751f75b-1d9b-455e-a097-46ee871d93cc {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:33 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2751f75b-1d9b-455e-a097-46ee871d93cc Jun 03 12:08:33 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa7a4e0e-029c-4590-9c8f-da327649f04f tempest-SnapshotDependencyTests-975463722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.info" returned: 0 in 0.786s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:34 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-aa7a4e0e-029c-4590-9c8f-da327649f04f tempest-SnapshotDependencyTests-975463722 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.info is being set with open permissions: ugo+rw Jun 03 12:08:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa7a4e0e-029c-4590-9c8f-da327649f04f tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:34 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:34 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.info Jun 03 12:08:34 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:34 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-50e57dbd-2c68-4781-b740-bee5b43f3a53 tempest-CinderUnicodeTest-2081806099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2751f75b-1d9b-455e-a097-46ee871d93cc" returned: 0 in 0.665s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-50e57dbd-2c68-4781-b740-bee5b43f3a53 tempest-CinderUnicodeTest-2081806099 None] Lock "cinder-quobyte-2751f75b-1d9b-455e-a097-46ee871d93cc" released by "delete_volume" :: held 1.714s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:34 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-50e57dbd-2c68-4781-b740-bee5b43f3a53 tempest-CinderUnicodeTest-2081806099 None] Created reservations ['175358e2-e608-49e5-ba45-c9d7cc1f5639', 'f9fded5a-9438-4302-965f-37775a63014a', '9c4edfdf-410d-474a-a5a4-1a13df52e4bb', '54961bc6-2696-4ec1-b989-8d322773afe9'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:08:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-50e57dbd-2c68-4781-b740-bee5b43f3a53 tempest-CinderUnicodeTest-2081806099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-50e57dbd-2c68-4781-b740-bee5b43f3a53 tempest-CinderUnicodeTest-2081806099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:34 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-50e57dbd-2c68-4781-b740-bee5b43f3a53 tempest-CinderUnicodeTest-2081806099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:08:34 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-50e57dbd-2c68-4781-b740-bee5b43f3a53 tempest-CinderUnicodeTest-2081806099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:08:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-50e57dbd-2c68-4781-b740-bee5b43f3a53 tempest-CinderUnicodeTest-2081806099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-50e57dbd-2c68-4781-b740-bee5b43f3a53 tempest-CinderUnicodeTest-2081806099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:34 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:08:34 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:34 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-aa7a4e0e-029c-4590-9c8f-da327649f04f tempest-SnapshotDependencyTests-975463722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.info" returned: 0 in 0.728s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-aa7a4e0e-029c-4590-9c8f-da327649f04f tempest-SnapshotDependencyTests-975463722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.918s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:34 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-aa7a4e0e-029c-4590-9c8f-da327649f04f tempest-SnapshotDependencyTests-975463722 None] Create snapshot completed successfully Jun 03 12:08:35 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-50e57dbd-2c68-4781-b740-bee5b43f3a53 tempest-CinderUnicodeTest-2081806099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.730s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:35 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-50e57dbd-2c68-4781-b740-bee5b43f3a53 tempest-CinderUnicodeTest-2081806099 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:08:35 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-50e57dbd-2c68-4781-b740-bee5b43f3a53 tempest-CinderUnicodeTest-2081806099 None] Deleted volume successfully. Jun 03 12:08:35 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-50e57dbd-2c68-4781-b740-bee5b43f3a53 tempest-CinderUnicodeTest-2081806099 None] Lock "cinder-2751f75b-1d9b-455e-a097-46ee871d93cc-delete_volume" released by "delete_volume" :: held 2.740s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:35 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:08:35 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Flow 'volume_create_manager' (80491c76-6fe6-44c9-a823-485110f41f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:08:35 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a019b8f-b78d-43af-88af-ea2ecd4520ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a019b8f-b78d-43af-88af-ea2ecd4520ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ff64c1-8037-4e59-a41f-906f070e70a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0efb8d107d8495f8e4abd770fd7ff5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=394f3c37-dd1c-47e5-af88-6127d3a5afd6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:08:36Z,use_quota=True,user_id='43a38e71c54146caaccbfba8f5cb5e60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be36ea78-e5da-4d86-bb13-1ce762b165f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be36ea78-e5da-4d86-bb13-1ce762b165f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098312eb-3401-4f3c-801b-e21b8a77f017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098312eb-3401-4f3c-801b-e21b8a77f017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd7ff64c1-8037-4e59-a41f-906f070e70a5', 'volume_name': 'volume-d7ff64c1-8037-4e59-a41f-906f070e70a5', 'volume_size': 1, 'snapshot_id': '394f3c37-dd1c-47e5-af88-6127d3a5afd6'}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e793e5fd-3fb0-4df4-a654-9869504e377f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e793e5fd-3fb0-4df4-a654-9869504e377f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242ad2f4-07b1-4b24-a8c9-c68f6333b352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:36 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Volume d7ff64c1-8037-4e59-a41f-906f070e70a5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d7ff64c1-8037-4e59-a41f-906f070e70a5', 'volume_size': 1, 'snapshot_id': '394f3c37-dd1c-47e5-af88-6127d3a5afd6'} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Acquiring lock "cinder-quobyte-394f3c37-dd1c-47e5-af88-6127d3a5afd6-d7ff64c1-8037-4e59-a41f-906f070e70a5" by "_create_volume_from_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Lock "cinder-quobyte-394f3c37-dd1c-47e5-af88-6127d3a5afd6-d7ff64c1-8037-4e59-a41f-906f070e70a5" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Creating volume d7ff64c1-8037-4e59-a41f-906f070e70a5 from snapshot 394f3c37-dd1c-47e5-af88-6127d3a5afd6 {{(pid=86724) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Acquiring lock "cinder-quobyte-d7ff64c1-8037-4e59-a41f-906f070e70a5" by "_copy_volume_from_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Lock "cinder-quobyte-d7ff64c1-8037-4e59-a41f-906f070e70a5" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] snapshot: 394f3c37-dd1c-47e5-af88-6127d3a5afd6, volume: d7ff64c1-8037-4e59-a41f-906f070e70a5, {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab81289-a41b-49b1-9b77-8860be21812d]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:36 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6 Jun 03 12:08:36 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:36 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6" returned: 0 in 0.805s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-252ebd22-02fd-427b-a9be-a37e4617c00f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] will copy from snapshot at /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Creating direct copy from snapshot {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a2224d-4ac5-4e24-9c6b-1cd3eedb5554]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:37 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:08:37 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:37 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f Jun 03 12:08:37 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:37 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:08:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Flow 'volume_create_manager' (4fde0d22-aa66-4a0e-8876-4ecb77882b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:08:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed10ebd-6944-4833-909b-af784fe7d076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed10ebd-6944-4833-909b-af784fe7d076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-348453449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e19c640-ec70-4bb8-a678-39687857564c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6434d88d750e4d66a8bd3020899039f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:08:37Z,use_quota=True,user_id='9a44a31435464f5da744c77927f63132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103d6108-f0cc-448f-80cb-5866322eb976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103d6108-f0cc-448f-80cb-5866322eb976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3bb082-8af1-42b1-a78b-2e6d16ad9bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3bb082-8af1-42b1-a78b-2e6d16ad9bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e19c640-ec70-4bb8-a678-39687857564c', 'volume_name': 'volume-6e19c640-ec70-4bb8-a678-39687857564c', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a78024-663d-480b-820a-f0542522e921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a78024-663d-480b-820a-f0542522e921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:37 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b8b482-d041-4331-b051-c996b318b5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:37 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Volume 6e19c640-ec70-4bb8-a678-39687857564c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e19c640-ec70-4bb8-a678-39687857564c', 'volume_size': 1} Jun 03 12:08:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:37 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.649s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:37 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:08:37 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f" returned: 0 in 0.774s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:37 devstack cinder-volume[86724]: DEBUG cinder.utils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Path /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d7ff64c1-8037-4e59-a41f-906f070e70a5 not found in is_blk_device check {{(pid=86724) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 03 12:08:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d7ff64c1-8037-4e59-a41f-906f070e70a5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:37 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d7ff64c1-8037-4e59-a41f-906f070e70a5 Jun 03 12:08:37 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:42 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d7ff64c1-8037-4e59-a41f-906f070e70a5" returned: 0 in 4.645s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:42 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c066929-125a-472b-8873-9266f1b48d4d]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:42 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f Jun 03 12:08:42 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:43 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f" returned: 0 in 0.863s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:43 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Image conversion details: src /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f, size 1024.00 MB, duration 4.65 sec, destination /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d7ff64c1-8037-4e59-a41f-906f070e70a5 {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 12:08:43 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Converted 1024.00 MB image at 220.41 MB/s Jun 03 12:08:43 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d7ff64c1-8037-4e59-a41f-906f070e70a5 is being set with open permissions: ugo+rw Jun 03 12:08:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d7ff64c1-8037-4e59-a41f-906f070e70a5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:43 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d7ff64c1-8037-4e59-a41f-906f070e70a5 Jun 03 12:08:43 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:43 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d7ff64c1-8037-4e59-a41f-906f070e70a5" returned: 0 in 0.606s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:43 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Lock "cinder-quobyte-d7ff64c1-8037-4e59-a41f-906f070e70a5" released by "_copy_volume_from_snapshot" :: held 7.805s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:43 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Lock "cinder-quobyte-394f3c37-dd1c-47e5-af88-6127d3a5afd6-d7ff64c1-8037-4e59-a41f-906f070e70a5" released by "_create_volume_from_snapshot" :: held 7.835s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.852s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.546s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-348453449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e19c640-ec70-4bb8-a678-39687857564c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6434d88d750e4d66a8bd3020899039f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:08:37Z,use_quota=True,user_id='9a44a31435464f5da744c77927f63132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:08:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Creating volume 6e19c640-ec70-4bb8-a678-39687857564c {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:08:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:08:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:08:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:08:43 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:08:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:43 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c 1073741824 Jun 03 12:08:43 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242ad2f4-07b1-4b24-a8c9-c68f6333b352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7ff64c1-8037-4e59-a41f-906f070e70a5', 'volume_size': 1, 'snapshot_id': '394f3c37-dd1c-47e5-af88-6127d3a5afd6'}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4cb2822-5eb8-48c9-8135-ff1239500ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:43 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Volume volume-d7ff64c1-8037-4e59-a41f-906f070e70a5 (d7ff64c1-8037-4e59-a41f-906f070e70a5): created successfully Jun 03 12:08:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4cb2822-5eb8-48c9-8135-ff1239500ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:44 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Flow 'volume_create_manager' (80491c76-6fe6-44c9-a823-485110f41f64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:08:44 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-ef6835c3-0fa5-4641-b778-5495e72baaac tempest-SnapshotDependencyTests-975463722 None] Created volume successfully. Jun 03 12:08:44 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c 1073741824" returned: 0 in 0.792s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:44 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] Acquiring lock "cinder-394f3c37-dd1c-47e5-af88-6127d3a5afd6-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:44 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] Lock "cinder-394f3c37-dd1c-47e5-af88-6127d3a5afd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:44 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] Acquiring lock "cinder-quobyte-252ebd22-02fd-427b-a9be-a37e4617c00f" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:44 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c Jun 03 12:08:44 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:44 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] Lock "cinder-quobyte-252ebd22-02fd-427b-a9be-a37e4617c00f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:44 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] Acquiring lock "cinder-quobyte-394f3c37-dd1c-47e5-af88-6127d3a5afd6" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:44 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] Lock "cinder-quobyte-394f3c37-dd1c-47e5-af88-6127d3a5afd6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:44 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] Deleting offline snapshot 394f3c37-dd1c-47e5-af88-6127d3a5afd6 of volume 252ebd22-02fd-427b-a9be-a37e4617c00f {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 12:08:44 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] snapshot_file for this snap is: volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 12:08:44 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8b9fcb-6974-4830-8b78-127a1fe788d4]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:44 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6 Jun 03 12:08:44 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:45 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c" returned: 0 in 0.614s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:08:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b8b482-d041-4331-b051-c996b318b5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e19c640-ec70-4bb8-a678-39687857564c', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5dfe6b4-c80f-43f5-b574-710c229defbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:08:45 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Volume volume-6e19c640-ec70-4bb8-a678-39687857564c (6e19c640-ec70-4bb8-a678-39687857564c): created successfully Jun 03 12:08:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5dfe6b4-c80f-43f5-b574-710c229defbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:08:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Flow 'volume_create_manager' (4fde0d22-aa66-4a0e-8876-4ecb77882b42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:08:45 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-2f89df23-2fb8-419e-9bbd-85a7a004a12f tempest-VolumesSnapshotListTestJSON-1992690210 None] Created volume successfully. Jun 03 12:08:45 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6" returned: 0 in 0.711s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-252ebd22-02fd-427b-a9be-a37e4617c00f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:08:45 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1306ed16-7c23-4c5d-a499-2ecdceeb4a4a]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:45 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f Jun 03 12:08:45 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-78e76938-1ccb-4737-8948-19e7dcf6c4b6 tempest-VolumesSnapshotListTestJSON-1992690210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-78e76938-1ccb-4737-8948-19e7dcf6c4b6 tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:46 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-78e76938-1ccb-4737-8948-19e7dcf6c4b6 tempest-VolumesSnapshotListTestJSON-1992690210 None] Creating offline snapshot c182310a-d569-42a9-b51f-4e7c9f285aa5 of volume 6e19c640-ec70-4bb8-a678-39687857564c {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 12:08:46 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6093a3-5b19-4e4a-aa32-1e29e13c74b9]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-78e76938-1ccb-4737-8948-19e7dcf6c4b6 tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:46 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c Jun 03 12:08:46 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:46 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f" returned: 0 in 0.734s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:46 devstack sudo[103598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6 Jun 03 12:08:46 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:46 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-78e76938-1ccb-4737-8948-19e7dcf6c4b6 tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c" returned: 0 in 0.737s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-78e76938-1ccb-4737-8948-19e7dcf6c4b6 tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:46 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 1G Jun 03 12:08:46 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:47 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6" returned: 0 in 0.729s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:47 devstack sudo[103608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6 Jun 03 12:08:47 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:47 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f.394f3c37-dd1c-47e5-af88-6127d3a5afd6" returned: 0 in 0.598s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:47 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-78e76938-1ccb-4737-8948-19e7dcf6c4b6 tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 1G" returned: 0 in 0.744s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-78e76938-1ccb-4737-8948-19e7dcf6c4b6 tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e19c640-ec70-4bb8-a678-39687857564c -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] Lock "cinder-quobyte-394f3c37-dd1c-47e5-af88-6127d3a5afd6" released by "_delete_snapshot" :: held 2.879s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] Lock "cinder-quobyte-252ebd22-02fd-427b-a9be-a37e4617c00f" released by "delete_snapshot" :: held 2.910s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:47 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e19c640-ec70-4bb8-a678-39687857564c -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 Jun 03 12:08:47 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:47 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] Created reservations ['5b97e144-d82e-4f76-9673-f85720751e01', 'bee23bc9-09aa-4434-9892-07070f0a6056', '640fa611-34c0-42ec-9399-f47d0ceb76c4', '61dc4aee-58e2-4bea-9a42-7e2e0276b189'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:08:47 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] Delete snapshot completed successfully. Jun 03 12:08:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b799e972-5f77-44ae-be15-60bcfb00c343 tempest-SnapshotDependencyTests-975463722 None] Lock "cinder-394f3c37-dd1c-47e5-af88-6127d3a5afd6-delete_snapshot" released by "delete_snapshot" :: held 3.058s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-96db5e61-d406-49fa-a179-48ad8119f9d9 tempest-SnapshotDependencyTests-975463722 None] Acquiring lock "cinder-252ebd22-02fd-427b-a9be-a37e4617c00f-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-96db5e61-d406-49fa-a179-48ad8119f9d9 tempest-SnapshotDependencyTests-975463722 None] Lock "cinder-252ebd22-02fd-427b-a9be-a37e4617c00f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-96db5e61-d406-49fa-a179-48ad8119f9d9 tempest-SnapshotDependencyTests-975463722 None] Acquiring lock "cinder-quobyte-252ebd22-02fd-427b-a9be-a37e4617c00f" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-96db5e61-d406-49fa-a179-48ad8119f9d9 tempest-SnapshotDependencyTests-975463722 None] Lock "cinder-quobyte-252ebd22-02fd-427b-a9be-a37e4617c00f" acquired by "delete_volume" :: waited 0.016s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:48 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f81371d-285f-413a-b93d-95f1e7853f8e]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-96db5e61-d406-49fa-a179-48ad8119f9d9 tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:48 devstack sudo[103616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f Jun 03 12:08:48 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:48 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-78e76938-1ccb-4737-8948-19e7dcf6c4b6 tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e19c640-ec70-4bb8-a678-39687857564c -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5" returned: 0 in 0.688s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:48 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-78e76938-1ccb-4737-8948-19e7dcf6c4b6 tempest-VolumesSnapshotListTestJSON-1992690210 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 is being set with open permissions: ugo+rw Jun 03 12:08:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-78e76938-1ccb-4737-8948-19e7dcf6c4b6 tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:48 devstack sudo[103621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 Jun 03 12:08:48 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:48 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-96db5e61-d406-49fa-a179-48ad8119f9d9 tempest-SnapshotDependencyTests-975463722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f" returned: 0 in 0.730s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-96db5e61-d406-49fa-a179-48ad8119f9d9 tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:48 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f Jun 03 12:08:48 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:48 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-78e76938-1ccb-4737-8948-19e7dcf6c4b6 tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5" returned: 0 in 0.588s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:48 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:UPDATE=146,cinder:DELETE=14,cinder:SELECT=121,cinder:INSERT=43 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:08:48 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=125,cinder:UPDATE=161,cinder:INSERT=43,cinder:DELETE=10 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:08:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-78e76938-1ccb-4737-8948-19e7dcf6c4b6 tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:49 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.info Jun 03 12:08:49 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:49 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-96db5e61-d406-49fa-a179-48ad8119f9d9 tempest-SnapshotDependencyTests-975463722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-252ebd22-02fd-427b-a9be-a37e4617c00f" returned: 0 in 0.629s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-96db5e61-d406-49fa-a179-48ad8119f9d9 tempest-SnapshotDependencyTests-975463722 None] Lock "cinder-quobyte-252ebd22-02fd-427b-a9be-a37e4617c00f" released by "delete_volume" :: held 1.411s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:49 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-96db5e61-d406-49fa-a179-48ad8119f9d9 tempest-SnapshotDependencyTests-975463722 None] Created reservations ['d4da5936-5ce0-4428-bdce-3505a1dc6cee', '884e36b4-e7a5-40f0-9e7c-5d10234611e2', '1f6c0bb5-6c78-42e2-82c8-04c8a3374336', 'db4bb723-5355-495f-9b63-2add823f234b'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:08:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-96db5e61-d406-49fa-a179-48ad8119f9d9 tempest-SnapshotDependencyTests-975463722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-96db5e61-d406-49fa-a179-48ad8119f9d9 tempest-SnapshotDependencyTests-975463722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-96db5e61-d406-49fa-a179-48ad8119f9d9 tempest-SnapshotDependencyTests-975463722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:08:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-96db5e61-d406-49fa-a179-48ad8119f9d9 tempest-SnapshotDependencyTests-975463722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:08:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-96db5e61-d406-49fa-a179-48ad8119f9d9 tempest-SnapshotDependencyTests-975463722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-96db5e61-d406-49fa-a179-48ad8119f9d9 tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:49 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:08:49 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:49 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-78e76938-1ccb-4737-8948-19e7dcf6c4b6 tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.info" returned: 0 in 0.633s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:49 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-78e76938-1ccb-4737-8948-19e7dcf6c4b6 tempest-VolumesSnapshotListTestJSON-1992690210 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.info is being set with open permissions: ugo+rw Jun 03 12:08:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-78e76938-1ccb-4737-8948-19e7dcf6c4b6 tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:49 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.info Jun 03 12:08:49 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:50 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-96db5e61-d406-49fa-a179-48ad8119f9d9 tempest-SnapshotDependencyTests-975463722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.616s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:50 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-96db5e61-d406-49fa-a179-48ad8119f9d9 tempest-SnapshotDependencyTests-975463722 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:08:50 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-96db5e61-d406-49fa-a179-48ad8119f9d9 tempest-SnapshotDependencyTests-975463722 None] Deleted volume successfully. Jun 03 12:08:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-13a41435-9509-4462-a129-6fdac9aa266b tempest-SnapshotDependencyTests-975463722 None] Acquiring lock "cinder-d7ff64c1-8037-4e59-a41f-906f070e70a5-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-13a41435-9509-4462-a129-6fdac9aa266b tempest-SnapshotDependencyTests-975463722 None] Lock "cinder-d7ff64c1-8037-4e59-a41f-906f070e70a5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-96db5e61-d406-49fa-a179-48ad8119f9d9 tempest-SnapshotDependencyTests-975463722 None] Lock "cinder-252ebd22-02fd-427b-a9be-a37e4617c00f-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-13a41435-9509-4462-a129-6fdac9aa266b tempest-SnapshotDependencyTests-975463722 None] Acquiring lock "cinder-quobyte-d7ff64c1-8037-4e59-a41f-906f070e70a5" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:50 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-78e76938-1ccb-4737-8948-19e7dcf6c4b6 tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.info" returned: 0 in 0.657s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-78e76938-1ccb-4737-8948-19e7dcf6c4b6 tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.150s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-13a41435-9509-4462-a129-6fdac9aa266b tempest-SnapshotDependencyTests-975463722 None] Lock "cinder-quobyte-d7ff64c1-8037-4e59-a41f-906f070e70a5" acquired by "delete_volume" :: waited 0.037s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:50 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[45544a4b-4f9f-4b85-847f-7f96f7d91511]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-13a41435-9509-4462-a129-6fdac9aa266b tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d7ff64c1-8037-4e59-a41f-906f070e70a5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:50 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-78e76938-1ccb-4737-8948-19e7dcf6c4b6 tempest-VolumesSnapshotListTestJSON-1992690210 None] Create snapshot completed successfully Jun 03 12:08:50 devstack sudo[103639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d7ff64c1-8037-4e59-a41f-906f070e70a5 Jun 03 12:08:50 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:51 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-13a41435-9509-4462-a129-6fdac9aa266b tempest-SnapshotDependencyTests-975463722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d7ff64c1-8037-4e59-a41f-906f070e70a5" returned: 0 in 0.706s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-13a41435-9509-4462-a129-6fdac9aa266b tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d7ff64c1-8037-4e59-a41f-906f070e70a5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:51 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d7ff64c1-8037-4e59-a41f-906f070e70a5 Jun 03 12:08:51 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f4cb8bdb-6957-4cfe-ab86-fe43fe80cd05 tempest-VolumesSnapshotListTestJSON-1992690210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f4cb8bdb-6957-4cfe-ab86-fe43fe80cd05 tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-f4cb8bdb-6957-4cfe-ab86-fe43fe80cd05 tempest-VolumesSnapshotListTestJSON-1992690210 None] Creating offline snapshot a0c544ed-a4ae-44ff-9419-64aaf69a55e7 of volume 6e19c640-ec70-4bb8-a678-39687857564c {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 12:08:51 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eedc205-f5c1-4396-be5b-9cbde2cb0bdf]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f4cb8bdb-6957-4cfe-ab86-fe43fe80cd05 tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:51 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-13a41435-9509-4462-a129-6fdac9aa266b tempest-SnapshotDependencyTests-975463722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d7ff64c1-8037-4e59-a41f-906f070e70a5" returned: 0 in 0.619s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:51 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-13a41435-9509-4462-a129-6fdac9aa266b tempest-SnapshotDependencyTests-975463722 None] Lock "cinder-quobyte-d7ff64c1-8037-4e59-a41f-906f070e70a5" released by "delete_volume" :: held 1.369s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:51 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 Jun 03 12:08:51 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:51 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-13a41435-9509-4462-a129-6fdac9aa266b tempest-SnapshotDependencyTests-975463722 None] Created reservations ['539d3156-7e3c-4339-9602-17dd4b256f55', 'eb00e904-a3d8-4aec-90da-a9e486a0a608', '7fa70f51-e317-4a70-90d6-9d545608f2ec', '4b441c4d-d793-43a6-b11a-7675063cdc32'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:08:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-13a41435-9509-4462-a129-6fdac9aa266b tempest-SnapshotDependencyTests-975463722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-13a41435-9509-4462-a129-6fdac9aa266b tempest-SnapshotDependencyTests-975463722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-13a41435-9509-4462-a129-6fdac9aa266b tempest-SnapshotDependencyTests-975463722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:08:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-13a41435-9509-4462-a129-6fdac9aa266b tempest-SnapshotDependencyTests-975463722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:08:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-13a41435-9509-4462-a129-6fdac9aa266b tempest-SnapshotDependencyTests-975463722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-13a41435-9509-4462-a129-6fdac9aa266b tempest-SnapshotDependencyTests-975463722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:51 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:08:51 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:52 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f4cb8bdb-6957-4cfe-ab86-fe43fe80cd05 tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5" returned: 0 in 0.719s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-f4cb8bdb-6957-4cfe-ab86-fe43fe80cd05 tempest-VolumesSnapshotListTestJSON-1992690210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e19c640-ec70-4bb8-a678-39687857564c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:08:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f4cb8bdb-6957-4cfe-ab86-fe43fe80cd05 tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:52 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 1G Jun 03 12:08:52 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:52 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-13a41435-9509-4462-a129-6fdac9aa266b tempest-SnapshotDependencyTests-975463722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.631s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:52 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-13a41435-9509-4462-a129-6fdac9aa266b tempest-SnapshotDependencyTests-975463722 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:08:52 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-13a41435-9509-4462-a129-6fdac9aa266b tempest-SnapshotDependencyTests-975463722 None] Deleted volume successfully. Jun 03 12:08:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-13a41435-9509-4462-a129-6fdac9aa266b tempest-SnapshotDependencyTests-975463722 None] Lock "cinder-d7ff64c1-8037-4e59-a41f-906f070e70a5-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:08:53 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f4cb8bdb-6957-4cfe-ab86-fe43fe80cd05 tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 1G" returned: 0 in 0.828s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f4cb8bdb-6957-4cfe-ab86-fe43fe80cd05 tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:53 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 Jun 03 12:08:53 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:53 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f4cb8bdb-6957-4cfe-ab86-fe43fe80cd05 tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7" returned: 0 in 0.670s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:53 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-f4cb8bdb-6957-4cfe-ab86-fe43fe80cd05 tempest-VolumesSnapshotListTestJSON-1992690210 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 is being set with open permissions: ugo+rw Jun 03 12:08:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f4cb8bdb-6957-4cfe-ab86-fe43fe80cd05 tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:53 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 Jun 03 12:08:53 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:54 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-f4cb8bdb-6957-4cfe-ab86-fe43fe80cd05 tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7" returned: 0 in 0.623s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-f4cb8bdb-6957-4cfe-ab86-fe43fe80cd05 tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.942s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:54 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-f4cb8bdb-6957-4cfe-ab86-fe43fe80cd05 tempest-VolumesSnapshotListTestJSON-1992690210 None] Create snapshot completed successfully Jun 03 12:08:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d093f1e7-a983-49fe-b4f6-0c7c5d05d413 tempest-VolumesSnapshotListTestJSON-1992690210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:08:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d093f1e7-a983-49fe-b4f6-0c7c5d05d413 tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:08:54 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-d093f1e7-a983-49fe-b4f6-0c7c5d05d413 tempest-VolumesSnapshotListTestJSON-1992690210 None] Creating offline snapshot c1936af0-5e5f-4be6-8335-e7606143f9d7 of volume 6e19c640-ec70-4bb8-a678-39687857564c {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 12:08:54 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea5120e-ab7d-4375-a0c7-d166c7eda2dc]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:08:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d093f1e7-a983-49fe-b4f6-0c7c5d05d413 tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:55 devstack sudo[103677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 Jun 03 12:08:55 devstack sudo[103677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:55 devstack sudo[103677]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d093f1e7-a983-49fe-b4f6-0c7c5d05d413 tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7" returned: 0 in 0.760s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:55 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-d093f1e7-a983-49fe-b4f6-0c7c5d05d413 tempest-VolumesSnapshotListTestJSON-1992690210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e19c640-ec70-4bb8-a678-39687857564c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:08:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d093f1e7-a983-49fe-b4f6-0c7c5d05d413 tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c1936af0-5e5f-4be6-8335-e7606143f9d7 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:55 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c1936af0-5e5f-4be6-8335-e7606143f9d7 1G Jun 03 12:08:55 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:56 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d093f1e7-a983-49fe-b4f6-0c7c5d05d413 tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c1936af0-5e5f-4be6-8335-e7606143f9d7 1G" returned: 0 in 0.907s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d093f1e7-a983-49fe-b4f6-0c7c5d05d413 tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c1936af0-5e5f-4be6-8335-e7606143f9d7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:56 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c1936af0-5e5f-4be6-8335-e7606143f9d7 Jun 03 12:08:56 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:57 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d093f1e7-a983-49fe-b4f6-0c7c5d05d413 tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c1936af0-5e5f-4be6-8335-e7606143f9d7" returned: 0 in 0.687s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:57 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-d093f1e7-a983-49fe-b4f6-0c7c5d05d413 tempest-VolumesSnapshotListTestJSON-1992690210 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c1936af0-5e5f-4be6-8335-e7606143f9d7 is being set with open permissions: ugo+rw Jun 03 12:08:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d093f1e7-a983-49fe-b4f6-0c7c5d05d413 tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c1936af0-5e5f-4be6-8335-e7606143f9d7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:08:57 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c1936af0-5e5f-4be6-8335-e7606143f9d7 Jun 03 12:08:57 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:08:57 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Jun 03 12:08:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d093f1e7-a983-49fe-b4f6-0c7c5d05d413 tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c1936af0-5e5f-4be6-8335-e7606143f9d7" returned: 0 in 0.619s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:08:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d093f1e7-a983-49fe-b4f6-0c7c5d05d413 tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.081s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:08:58 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d093f1e7-a983-49fe-b4f6-0c7c5d05d413 tempest-VolumesSnapshotListTestJSON-1992690210 None] Create snapshot completed successfully Jun 03 12:08:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] Acquiring lock "cinder-c1936af0-5e5f-4be6-8335-e7606143f9d7-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:08:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-c1936af0-5e5f-4be6-8335-e7606143f9d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:08:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] Acquiring lock "cinder-quobyte-6e19c640-ec70-4bb8-a678-39687857564c" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:09:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-quobyte-6e19c640-ec70-4bb8-a678-39687857564c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:09:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] Acquiring lock "cinder-quobyte-c1936af0-5e5f-4be6-8335-e7606143f9d7" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:09:00 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-quobyte-c1936af0-5e5f-4be6-8335-e7606143f9d7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:09:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] Deleting offline snapshot c1936af0-5e5f-4be6-8335-e7606143f9d7 of volume 6e19c640-ec70-4bb8-a678-39687857564c {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 12:09:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] snapshot_file for this snap is: volume-6e19c640-ec70-4bb8-a678-39687857564c.c1936af0-5e5f-4be6-8335-e7606143f9d7 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 12:09:00 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9d464c-a216-4d3f-b1c6-8bef7378bee9]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:09:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c1936af0-5e5f-4be6-8335-e7606143f9d7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:09:00 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c1936af0-5e5f-4be6-8335-e7606143f9d7 Jun 03 12:09:00 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:09:00 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Jun 03 12:09:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c1936af0-5e5f-4be6-8335-e7606143f9d7" returned: 0 in 0.865s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:09:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e19c640-ec70-4bb8-a678-39687857564c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:09:00 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00f8f44-7a67-46b9-b9c3-c466234def0b]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:09:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:09:01 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 Jun 03 12:09:01 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:09:01 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Jun 03 12:09:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7" returned: 0 in 0.737s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:09:01 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e19c640-ec70-4bb8-a678-39687857564c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:09:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c1936af0-5e5f-4be6-8335-e7606143f9d7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:09:01 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c1936af0-5e5f-4be6-8335-e7606143f9d7 Jun 03 12:09:01 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:09:02 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Jun 03 12:09:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c1936af0-5e5f-4be6-8335-e7606143f9d7" returned: 0 in 0.761s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:09:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c1936af0-5e5f-4be6-8335-e7606143f9d7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:09:02 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c1936af0-5e5f-4be6-8335-e7606143f9d7 Jun 03 12:09:02 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:09:03 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Jun 03 12:09:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c1936af0-5e5f-4be6-8335-e7606143f9d7" returned: 0 in 0.622s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:09:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-quobyte-c1936af0-5e5f-4be6-8335-e7606143f9d7" released by "_delete_snapshot" :: held 3.099s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:09:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-quobyte-6e19c640-ec70-4bb8-a678-39687857564c" released by "delete_snapshot" :: held 3.120s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:09:03 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] Created reservations ['53efa4fc-d1e4-4196-ac12-e8eaca3e1d67', '08165783-cc17-48dd-9658-9d57fc47e0a6', 'dc2b4bb1-803e-4552-8d9e-a91260432846', '297235fe-f791-4ad7-9683-c5283d27ef66'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:09:03 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] Delete snapshot completed successfully. Jun 03 12:09:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b9f9dbce-6ec5-410a-b5fe-a32d276e53ba tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-c1936af0-5e5f-4be6-8335-e7606143f9d7-delete_snapshot" released by "delete_snapshot" :: held 3.254s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:09:04 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] Acquiring lock "cinder-a0c544ed-a4ae-44ff-9419-64aaf69a55e7-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:09:04 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-a0c544ed-a4ae-44ff-9419-64aaf69a55e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:09:04 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] Acquiring lock "cinder-quobyte-6e19c640-ec70-4bb8-a678-39687857564c" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:09:04 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-quobyte-6e19c640-ec70-4bb8-a678-39687857564c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:09:04 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] Acquiring lock "cinder-quobyte-a0c544ed-a4ae-44ff-9419-64aaf69a55e7" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:09:04 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-quobyte-a0c544ed-a4ae-44ff-9419-64aaf69a55e7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:09:04 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] Deleting offline snapshot a0c544ed-a4ae-44ff-9419-64aaf69a55e7 of volume 6e19c640-ec70-4bb8-a678-39687857564c {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 12:09:04 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] snapshot_file for this snap is: volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 12:09:04 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d055a9-4786-4ab4-8221-19bce8fd3517]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:09:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:09:04 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 Jun 03 12:09:04 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:09:05 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Jun 03 12:09:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7" returned: 0 in 0.742s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:09:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e19c640-ec70-4bb8-a678-39687857564c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:09:05 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[87644f88-bd4a-4a0b-ac26-a1e450c5a6c3]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:09:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:09:05 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 Jun 03 12:09:05 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:09:05 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Jun 03 12:09:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5" returned: 0 in 0.702s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:09:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e19c640-ec70-4bb8-a678-39687857564c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:09:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:09:05 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 Jun 03 12:09:05 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:09:06 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Jun 03 12:09:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7" returned: 0 in 0.699s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:09:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:09:06 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7 Jun 03 12:09:06 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:09:07 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Jun 03 12:09:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.a0c544ed-a4ae-44ff-9419-64aaf69a55e7" returned: 0 in 0.611s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:09:07 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-quobyte-a0c544ed-a4ae-44ff-9419-64aaf69a55e7" released by "_delete_snapshot" :: held 2.845s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:09:07 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-quobyte-6e19c640-ec70-4bb8-a678-39687857564c" released by "delete_snapshot" :: held 2.866s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:09:07 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] Created reservations ['fc5e93a0-b373-4e91-843f-9a2a5ebae0f4', 'dec146e7-9314-46f4-b2c9-d5bc4b233731', 'ef28cbe7-7a44-46f4-acf3-fcd36eae4ff7', '75cdaf0d-99b8-435a-a52c-ddb0ac96e9c7'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:09:07 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] Delete snapshot completed successfully. Jun 03 12:09:07 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-433b84dc-6404-4363-bb9e-6f079adfa78b tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-a0c544ed-a4ae-44ff-9419-64aaf69a55e7-delete_snapshot" released by "delete_snapshot" :: held 2.987s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:09:07 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] Acquiring lock "cinder-c182310a-d569-42a9-b51f-4e7c9f285aa5-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:09:07 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-c182310a-d569-42a9-b51f-4e7c9f285aa5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:09:07 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] Acquiring lock "cinder-quobyte-6e19c640-ec70-4bb8-a678-39687857564c" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:09:07 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-quobyte-6e19c640-ec70-4bb8-a678-39687857564c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:09:07 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] Acquiring lock "cinder-quobyte-c182310a-d569-42a9-b51f-4e7c9f285aa5" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:09:07 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-quobyte-c182310a-d569-42a9-b51f-4e7c9f285aa5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:09:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] Deleting offline snapshot c182310a-d569-42a9-b51f-4e7c9f285aa5 of volume 6e19c640-ec70-4bb8-a678-39687857564c {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 12:09:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] snapshot_file for this snap is: volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 12:09:07 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1659de-6f38-4c4a-ae7e-3bccaf1a21e1]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:09:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:09:07 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 Jun 03 12:09:07 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:09:08 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Jun 03 12:09:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5" returned: 0 in 0.706s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:09:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e19c640-ec70-4bb8-a678-39687857564c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:09:08 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5426401d-ec81-48b3-b6ca-2bd2088d5091]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:09:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:09:08 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c Jun 03 12:09:08 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:09:08 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Jun 03 12:09:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c" returned: 0 in 0.706s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:09:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:09:08 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 Jun 03 12:09:08 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:09:09 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Jun 03 12:09:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5" returned: 0 in 0.696s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:09:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:09:09 devstack sudo[103792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5 Jun 03 12:09:09 devstack sudo[103792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:09:10 devstack sudo[103792]: pam_unix(sudo:session): session closed for user root Jun 03 12:09:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c.c182310a-d569-42a9-b51f-4e7c9f285aa5" returned: 0 in 0.617s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:09:10 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-quobyte-c182310a-d569-42a9-b51f-4e7c9f285aa5" released by "_delete_snapshot" :: held 2.821s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:09:10 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-quobyte-6e19c640-ec70-4bb8-a678-39687857564c" released by "delete_snapshot" :: held 2.843s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:09:10 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] Created reservations ['66c0da33-1e36-4bad-97a2-95b579b535df', 'a3b909d2-19a9-4c51-b557-53ff19104aa9', '3c19252f-cdb9-4430-beb6-b42de7051f6b', '5966dd57-3d86-4cd9-8443-d0d9b4b52092'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:09:10 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] Delete snapshot completed successfully. Jun 03 12:09:10 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-194ce7d9-9490-44d5-b338-4e95256832b0 tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-c182310a-d569-42a9-b51f-4e7c9f285aa5-delete_snapshot" released by "delete_snapshot" :: held 2.980s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:09:10 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-73162add-1281-45e4-a249-a002e5fccadf tempest-VolumesSnapshotListTestJSON-1992690210 None] Acquiring lock "cinder-6e19c640-ec70-4bb8-a678-39687857564c-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:09:10 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-73162add-1281-45e4-a249-a002e5fccadf tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-6e19c640-ec70-4bb8-a678-39687857564c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:09:10 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-73162add-1281-45e4-a249-a002e5fccadf tempest-VolumesSnapshotListTestJSON-1992690210 None] Acquiring lock "cinder-quobyte-6e19c640-ec70-4bb8-a678-39687857564c" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:09:10 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-73162add-1281-45e4-a249-a002e5fccadf tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-quobyte-6e19c640-ec70-4bb8-a678-39687857564c" acquired by "delete_volume" :: waited 0.015s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:09:10 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[045104aa-f7a0-44bf-9ff3-ec149a49e38e]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:09:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-73162add-1281-45e4-a249-a002e5fccadf tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:09:10 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c Jun 03 12:09:10 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:09:11 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Jun 03 12:09:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-73162add-1281-45e4-a249-a002e5fccadf tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c" returned: 0 in 0.715s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:09:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-73162add-1281-45e4-a249-a002e5fccadf tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:09:11 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c Jun 03 12:09:11 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:09:12 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Jun 03 12:09:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-73162add-1281-45e4-a249-a002e5fccadf tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-6e19c640-ec70-4bb8-a678-39687857564c" returned: 0 in 0.626s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:09:12 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-73162add-1281-45e4-a249-a002e5fccadf tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-quobyte-6e19c640-ec70-4bb8-a678-39687857564c" released by "delete_volume" :: held 1.398s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:09:12 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-73162add-1281-45e4-a249-a002e5fccadf tempest-VolumesSnapshotListTestJSON-1992690210 None] Created reservations ['3143a837-d6d7-49a8-b929-62217c078663', '3c329fcf-0b07-44e6-886d-031d207c34b8', '6c39e763-7e86-481d-b015-3bc8f880fa39', '34493a7c-1bc6-4621-8216-b724f09c0c50'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:09:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-73162add-1281-45e4-a249-a002e5fccadf tempest-VolumesSnapshotListTestJSON-1992690210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:09:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-73162add-1281-45e4-a249-a002e5fccadf tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:09:12 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-73162add-1281-45e4-a249-a002e5fccadf tempest-VolumesSnapshotListTestJSON-1992690210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:09:12 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-73162add-1281-45e4-a249-a002e5fccadf tempest-VolumesSnapshotListTestJSON-1992690210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:09:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-73162add-1281-45e4-a249-a002e5fccadf tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:09:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-73162add-1281-45e4-a249-a002e5fccadf tempest-VolumesSnapshotListTestJSON-1992690210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:09:12 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:09:12 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:09:12 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Jun 03 12:09:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-73162add-1281-45e4-a249-a002e5fccadf tempest-VolumesSnapshotListTestJSON-1992690210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.591s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:09:12 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-73162add-1281-45e4-a249-a002e5fccadf tempest-VolumesSnapshotListTestJSON-1992690210 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:09:12 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-73162add-1281-45e4-a249-a002e5fccadf tempest-VolumesSnapshotListTestJSON-1992690210 None] Deleted volume successfully. Jun 03 12:09:12 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-73162add-1281-45e4-a249-a002e5fccadf tempest-VolumesSnapshotListTestJSON-1992690210 None] Lock "cinder-6e19c640-ec70-4bb8-a678-39687857564c-delete_volume" released by "delete_volume" :: held 2.181s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:09:22 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=40,cinder:UPDATE=39,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:09:22 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=30,cinder:INSERT=13,cinder:UPDATE=47,cinder:DELETE=3 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:09:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 12:09:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:09:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:09:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:09:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:09:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:09:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:09:37 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:09:37 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:09:37 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Jun 03 12:09:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.608s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:09:37 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Flow 'volume_create_manager' (ee18f0b2-d6ab-4e3b-9b63-e6d8053f1abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6f06a7-b8a5-4955-a468-bc18501c34b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6f06a7-b8a5-4955-a468-bc18501c34b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-261734664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aad29e245b34177b70f6a9caa7335bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:10:10Z,use_quota=True,user_id='8d75e4379cc94bb297ebf760ba22c638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92940fb4-ed32-4563-9398-890c6335609c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92940fb4-ed32-4563-9398-890c6335609c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d45b3b-cf63-4050-adda-a1d4339e6fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d45b3b-cf63-4050-adda-a1d4339e6fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915', 'volume_name': 'volume-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38c2cc3-b56c-4a17-a6e2-97a9b2bf3af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38c2cc3-b56c-4a17-a6e2-97a9b2bf3af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80f7b34-366e-4e04-88e2-5b2d359afa21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:10 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Volume 52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915', 'volume_size': 1} Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-261734664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aad29e245b34177b70f6a9caa7335bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:10:10Z,use_quota=True,user_id='8d75e4379cc94bb297ebf760ba22c638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Creating volume 52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:10:10 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:10:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:10:10 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915 1073741824 Jun 03 12:10:10 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:10:11 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Jun 03 12:10:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915 1073741824" returned: 0 in 0.767s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:10:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:10:11 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915 Jun 03 12:10:11 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:10:11 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Jun 03 12:10:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915" returned: 0 in 0.606s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:10:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:10:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:10:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80f7b34-366e-4e04-88e2-5b2d359afa21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d1a1e1-bc06-48bd-851d-f495570e227a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:11 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Volume volume-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915 (52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915): created successfully Jun 03 12:10:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d1a1e1-bc06-48bd-851d-f495570e227a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Flow 'volume_create_manager' (ee18f0b2-d6ab-4e3b-9b63-e6d8053f1abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:10:11 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-ff3254e2-356c-451e-993c-31e61a8b2ae0 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Created volume successfully. Jun 03 12:10:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-875ab84d-bdc9-4935-b0ec-e59403ddf529 req-40086f1f-9f96-4328-8c83-f5ed6302d8d1 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:10:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-875ab84d-bdc9-4935-b0ec-e59403ddf529 req-40086f1f-9f96-4328-8c83-f5ed6302d8d1 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:10:15 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c46bba-a7ad-4bd6-ab0a-caac1117a313]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:10:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-875ab84d-bdc9-4935-b0ec-e59403ddf529 req-40086f1f-9f96-4328-8c83-f5ed6302d8d1 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:10:15 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915 Jun 03 12:10:15 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:10:16 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Jun 03 12:10:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [req-875ab84d-bdc9-4935-b0ec-e59403ddf529 req-40086f1f-9f96-4328-8c83-f5ed6302d8d1 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915" returned: 0 in 0.705s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:10:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [req-875ab84d-bdc9-4935-b0ec-e59403ddf529 req-40086f1f-9f96-4328-8c83-f5ed6302d8d1 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.722s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:10:16 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-875ab84d-bdc9-4935-b0ec-e59403ddf529 req-40086f1f-9f96-4328-8c83-f5ed6302d8d1 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6', 'name': 'volume-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e3e7555-c0dc-46f4-9454-5f9f4c2678b8', 'enforce_multipath': True} {{(pid=86724) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 03 12:10:16 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-875ab84d-bdc9-4935-b0ec-e59403ddf529 req-40086f1f-9f96-4328-8c83-f5ed6302d8d1 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] attachment_update completed successfully. Jun 03 12:10:22 devstack cinder-volume[86724]: INFO cinder.volume.manager [req-4cf08d2e-84ac-4885-b1a2-4225e150458c req-543847f3-a636-4ea7-8d5a-2a06109f2bb5 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Terminate volume connection completed successfully. Jun 03 12:10:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [req-4cf08d2e-84ac-4885-b1a2-4225e150458c req-543847f3-a636-4ea7-8d5a-2a06109f2bb5 tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Deleting attachment 8e3e7555-c0dc-46f4-9454-5f9f4c2678b8. {{(pid=86724) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 03 12:10:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0ed5b3c6-3904-496d-96b4-ecb87b58237a tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Acquiring lock "cinder-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:10:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0ed5b3c6-3904-496d-96b4-ecb87b58237a tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Lock "cinder-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:10:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0ed5b3c6-3904-496d-96b4-ecb87b58237a tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Acquiring lock "cinder-quobyte-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:10:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0ed5b3c6-3904-496d-96b4-ecb87b58237a tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Lock "cinder-quobyte-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915" acquired by "delete_volume" :: waited 0.017s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:10:24 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b632a455-091e-4e83-aa5c-0892613f910b]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:10:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0ed5b3c6-3904-496d-96b4-ecb87b58237a tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:10:24 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915 Jun 03 12:10:24 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:10:25 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Jun 03 12:10:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0ed5b3c6-3904-496d-96b4-ecb87b58237a tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915" returned: 0 in 0.733s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:10:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0ed5b3c6-3904-496d-96b4-ecb87b58237a tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:10:25 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915 Jun 03 12:10:25 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:10:26 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Jun 03 12:10:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0ed5b3c6-3904-496d-96b4-ecb87b58237a tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915" returned: 0 in 0.627s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:10:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0ed5b3c6-3904-496d-96b4-ecb87b58237a tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Lock "cinder-quobyte-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915" released by "delete_volume" :: held 1.401s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:10:26 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-0ed5b3c6-3904-496d-96b4-ecb87b58237a tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Created reservations ['2a773e7f-d2c5-4ea9-9d8d-3f502b12ad52', '22706fd3-2bd8-4602-b395-9b958a94e512', 'd9ffdf7e-1dce-46b0-a7fb-032191925ce9', '25274cde-7339-4b86-b7bc-1e049f291448'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:10:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0ed5b3c6-3904-496d-96b4-ecb87b58237a tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:10:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0ed5b3c6-3904-496d-96b4-ecb87b58237a tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:10:26 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0ed5b3c6-3904-496d-96b4-ecb87b58237a tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:10:26 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0ed5b3c6-3904-496d-96b4-ecb87b58237a tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:10:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0ed5b3c6-3904-496d-96b4-ecb87b58237a tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:10:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0ed5b3c6-3904-496d-96b4-ecb87b58237a tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:10:26 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:10:26 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:10:26 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Jun 03 12:10:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0ed5b3c6-3904-496d-96b4-ecb87b58237a tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.613s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:10:26 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-0ed5b3c6-3904-496d-96b4-ecb87b58237a tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:10:26 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-0ed5b3c6-3904-496d-96b4-ecb87b58237a tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Deleted volume successfully. Jun 03 12:10:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0ed5b3c6-3904-496d-96b4-ecb87b58237a tempest-TestServerVolumeAttachScenarioOldVersion-661674787 None] Lock "cinder-52cf1cd2-cdac-4fa1-9b5b-fcc9bf811915-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:10:36 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:UPDATE=14,cinder:INSERT=4,cinder:SELECT=9 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:10:36 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=19,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=1 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:10:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 12:10:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:10:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:10:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:10:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:10:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:10:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:10:37 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:10:37 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:10:37 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Jun 03 12:10:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.653s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:10:37 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Flow 'volume_create_manager' (3d6b5293-9af2-4446-bbfc-16e029dd7b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75be25d-80ca-45b4-8df6-bc58d70225a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75be25d-80ca-45b4-8df6-bc58d70225a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1151147176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722ddd52-ac26-4e6d-8d25-45d035a7dd2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ada3a2cc4d41ee948c0e60022be671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:10:54Z,use_quota=True,user_id='70a3aab1ed29420eba7f4e410ec13852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3321be9d-71cf-4f6b-a551-15488976bd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3321be9d-71cf-4f6b-a551-15488976bd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f40c9f-f7e0-46a5-a212-30f2f176411f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f40c9f-f7e0-46a5-a212-30f2f176411f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '722ddd52-ac26-4e6d-8d25-45d035a7dd2b', 'volume_name': 'volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c05c521-84d8-469c-b279-3bad2d8da167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c05c521-84d8-469c-b279-3bad2d8da167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb37512b-64b8-4c20-8149-38d4fab2fec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:54 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Volume 722ddd52-ac26-4e6d-8d25-45d035a7dd2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b', 'volume_size': 1} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1151147176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722ddd52-ac26-4e6d-8d25-45d035a7dd2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ada3a2cc4d41ee948c0e60022be671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:10:54Z,use_quota=True,user_id='70a3aab1ed29420eba7f4e410ec13852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Creating volume 722ddd52-ac26-4e6d-8d25-45d035a7dd2b {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:10:54 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:10:54 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b 1073741824 Jun 03 12:10:54 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Flow 'volume_create_manager' (33ed4950-0920-4029-83a5-3fe6d7c06a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9989adf-d77f-4072-90e3-3f87c8525e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9989adf-d77f-4072-90e3-3f87c8525e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-793308932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64fdf3a7-7bd1-4d2e-a034-fbabac56d552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b933c38111ea4b2c87db887af77e9a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:10:54Z,use_quota=True,user_id='41cabcfeda3549509c5427eb37a467c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7bbb74-7a73-4782-b270-66abd1a5a5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7bbb74-7a73-4782-b270-66abd1a5a5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d11517-519b-4d5c-afcc-e873969eab2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d11517-519b-4d5c-afcc-e873969eab2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64fdf3a7-7bd1-4d2e-a034-fbabac56d552', 'volume_name': 'volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe012c07-ad5d-4acc-a602-a6dee9f65abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe012c07-ad5d-4acc-a602-a6dee9f65abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f055caae-fb79-4292-b272-67df635319ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:54 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Volume 64fdf3a7-7bd1-4d2e-a034-fbabac56d552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552', 'volume_size': 1} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Flow 'volume_create_manager' (cd7759b7-916a-4348-9256-7ae5b2aa1f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2997d0-ff29-4421-ba99-2504551df99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2997d0-ff29-4421-ba99-2504551df99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1550513010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b68ef9-9fb7-410c-a878-1ba50669264a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a45f959689449487efd1606d553c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:10:55Z,use_quota=True,user_id='3cabb2467cd7434a9316a3eb27423bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83959f6-d4d3-44df-9f7e-c5509b1f5ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83959f6-d4d3-44df-9f7e-c5509b1f5ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce8a8f8-80c0-44ab-a779-0e89e843974d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce8a8f8-80c0-44ab-a779-0e89e843974d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87b68ef9-9fb7-410c-a878-1ba50669264a', 'volume_name': 'volume-87b68ef9-9fb7-410c-a878-1ba50669264a', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13b6937-31f8-4a02-8128-6a4ca30c4003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13b6937-31f8-4a02-8128-6a4ca30c4003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a81fa460-b61e-44eb-a783-a3559d64df4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:55 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Volume 87b68ef9-9fb7-410c-a878-1ba50669264a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87b68ef9-9fb7-410c-a878-1ba50669264a', 'volume_size': 1} Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:10:55 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b 1073741824" returned: 0 in 0.939s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:10:55 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b Jun 03 12:10:55 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:10:55 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b" returned: 0 in 0.617s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.464s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-793308932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64fdf3a7-7bd1-4d2e-a034-fbabac56d552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b933c38111ea4b2c87db887af77e9a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:10:54Z,use_quota=True,user_id='41cabcfeda3549509c5427eb37a467c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Creating volume 64fdf3a7-7bd1-4d2e-a034-fbabac56d552 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:10:55 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:10:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:10:56 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 1073741824 Jun 03 12:10:56 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:10:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb37512b-64b8-4c20-8149-38d4fab2fec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e0cfa1-fd82-4fb9-a6e6-173c91a621b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:56 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Volume volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b (722ddd52-ac26-4e6d-8d25-45d035a7dd2b): created successfully Jun 03 12:10:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e0cfa1-fd82-4fb9-a6e6-173c91a621b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:56 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Flow 'volume_create_manager' (3d6b5293-9af2-4446-bbfc-16e029dd7b2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:10:56 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-6bd726a9-abcd-4e16-989d-57f620675014 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Created volume successfully. Jun 03 12:10:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-354f8a32-ca3f-4927-bc8e-5a133cebe85c tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:10:56 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jun 03 12:10:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 1073741824" returned: 0 in 0.846s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:10:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:10:56 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 Jun 03 12:10:56 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:10:57 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552" returned: 0 in 0.647s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.480s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1550513010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b68ef9-9fb7-410c-a878-1ba50669264a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a45f959689449487efd1606d553c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:10:55Z,use_quota=True,user_id='3cabb2467cd7434a9316a3eb27423bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Creating volume 87b68ef9-9fb7-410c-a878-1ba50669264a {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:10:57 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-87b68ef9-9fb7-410c-a878-1ba50669264a 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:10:57 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-87b68ef9-9fb7-410c-a878-1ba50669264a 1073741824 Jun 03 12:10:57 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f055caae-fb79-4292-b272-67df635319ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39c994d-02ef-4996-9a1b-f0edc189251c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:57 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Volume volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 (64fdf3a7-7bd1-4d2e-a034-fbabac56d552): created successfully Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39c994d-02ef-4996-9a1b-f0edc189251c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Flow 'volume_create_manager' (33ed4950-0920-4029-83a5-3fe6d7c06a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:10:57 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-e58d603a-35cb-4e49-9d53-6b31ea218333 tempest-VolumeDependencyTests-1714046286 None] Created volume successfully. Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Flow 'volume_create_manager' (8fada83d-7c69-44e7-8183-07d5e17ab5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6bfca8-6ff7-4193-a9f2-250662a42389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6bfca8-6ff7-4193-a9f2-250662a42389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdab1034-f326-4e7d-aff4-67a56cdc34d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cecdd4806d447bdbeac466077c3e349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:10:58Z,use_quota=True,user_id='f9242b39f0134b70bb551150865bb995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7fad87a-5d1f-4618-963c-252e7a6b5eb5),volume_type_id=a7fad87a-5d1f-4618-963c-252e7a6b5eb5)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b89abad-dc47-4431-864c-fec0a0fac8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b89abad-dc47-4431-864c-fec0a0fac8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc0d00a-176e-406a-b2a6-b630e0cad759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:57 devstack cinder-volume[86724]: DEBUG cinder.image.glance [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Creating Keystone auth plugin from conf {{(pid=86724) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 03 12:10:58 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc0d00a-176e-406a-b2a6-b630e0cad759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fdab1034-f326-4e7d-aff4-67a56cdc34d7', 'volume_name': 'volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7', 'volume_size': 1, 'image_id': '72797c2b-f70b-4084-aa4e-37422dcfd42d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72797c2b-f70b-4084-aa4e-37422dcfd42d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3357d06c7a45fa71ad58cfb3623972ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4cecdd4806d447bdbeac466077c3e349', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9ce98184d9b3b905235ac67e06d49928dfb0d7935c0aedb21b881854e32e551257e738a4f8ec0e37115adf213acaa1f781ef561315e9d9ca72cef37f9dcab1e2', 'id': '72797c2b-f70b-4084-aa4e-37422dcfd42d', 'created_at': datetime.datetime(2026, 6, 3, 10, 10, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 10, 10, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72797c2b-f70b-4084-aa4e-37422dcfd42d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:58 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6fa7d6-e069-4f10-aade-9bfb463619eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:58 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6fa7d6-e069-4f10-aade-9bfb463619eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:58 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8ea7b5-49d8-494d-97de-c27f0735f0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:58 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Volume fdab1034-f326-4e7d-aff4-67a56cdc34d7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7', 'volume_size': 1, 'image_id': '72797c2b-f70b-4084-aa4e-37422dcfd42d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72797c2b-f70b-4084-aa4e-37422dcfd42d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3357d06c7a45fa71ad58cfb3623972ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4cecdd4806d447bdbeac466077c3e349', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9ce98184d9b3b905235ac67e06d49928dfb0d7935c0aedb21b881854e32e551257e738a4f8ec0e37115adf213acaa1f781ef561315e9d9ca72cef37f9dcab1e2', 'id': '72797c2b-f70b-4084-aa4e-37422dcfd42d', 'created_at': datetime.datetime(2026, 6, 3, 10, 10, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 10, 10, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72797c2b-f70b-4084-aa4e-37422dcfd42d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 03 12:10:58 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Trying to clone fdab1034-f326-4e7d-aff4-67a56cdc34d7 from image 72797c2b-f70b-4084-aa4e-37422dcfd42d at location (None, [{'url': 'file:///opt/stack/data/glance/images/72797c2b-f70b-4084-aa4e-37422dcfd42d', 'metadata': {}}]). {{(pid=86724) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 03 12:10:58 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 03 12:10:58 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Image download 0.00 MB at 0.00 MB/s Jun 03 12:10:58 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[46284532-67c6-4cbe-99bb-8d45ac685c27]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:10:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:10:58 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jun 03 12:10:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-87b68ef9-9fb7-410c-a878-1ba50669264a 1073741824" returned: 0 in 0.854s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:10:58 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD Jun 03 12:10:58 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:10:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-87b68ef9-9fb7-410c-a878-1ba50669264a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:10:58 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-87b68ef9-9fb7-410c-a878-1ba50669264a Jun 03 12:10:58 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:10:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4262270c-96e3-4cd1-b6ab-d8ce74f3d32e tempest-VolumeDependencyTests-1714046286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:10:59 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Jun 03 12:10:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD" returned: 0 in 0.711s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:10:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:10:59 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Jun 03 12:10:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-87b68ef9-9fb7-410c-a878-1ba50669264a" returned: 0 in 0.680s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:10:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:10:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:10:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-354f8a32-ca3f-4927-bc8e-5a133cebe85c tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.498s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:10:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-354f8a32-ca3f-4927-bc8e-5a133cebe85c tempest-CreateVolumesFromSnapshotTest-1693238937 None] Creating offline snapshot adc8531a-35f2-455a-baf3-9bca76abe28f of volume 722ddd52-ac26-4e6d-8d25-45d035a7dd2b {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 12:10:59 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD Jun 03 12:10:59 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:10:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a81fa460-b61e-44eb-a783-a3559d64df4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b68ef9-9fb7-410c-a878-1ba50669264a', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51eb5ebd-6ca6-47d3-a114-b52174dc34d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:10:59 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e6e45f-637b-431b-8a9b-7b488497da2c]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:10:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-354f8a32-ca3f-4927-bc8e-5a133cebe85c tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:10:59 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Volume volume-87b68ef9-9fb7-410c-a878-1ba50669264a (87b68ef9-9fb7-410c-a878-1ba50669264a): created successfully Jun 03 12:10:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51eb5ebd-6ca6-47d3-a114-b52174dc34d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:10:59 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Flow 'volume_create_manager' (cd7759b7-916a-4348-9256-7ae5b2aa1f7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:10:59 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-7a85d772-62f1-4610-8640-67c177d3a7cf tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Created volume successfully. Jun 03 12:10:59 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b Jun 03 12:10:59 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:10:59 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Jun 03 12:10:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD" returned: 1 in 0.749s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:10:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:10:59 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Temporary image 72797c2b-f70b-4084-aa4e-37422dcfd42d is fetched for user f9242b39f0134b70bb551150865bb995. {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 03 12:10:59 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c41b6f-0d1b-44c6-866a-64b85c34c150]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:10:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:10:59 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Jun 03 12:10:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-354f8a32-ca3f-4927-bc8e-5a133cebe85c tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b" returned: 0 in 0.762s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:10:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-354f8a32-ca3f-4927-bc8e-5a133cebe85c tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.adc8531a-35f2-455a-baf3-9bca76abe28f 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:10:59 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.adc8531a-35f2-455a-baf3-9bca76abe28f 1G Jun 03 12:10:59 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:10:59 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD Jun 03 12:10:59 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:00 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD" returned: 0 in 0.723s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:00 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:11:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Flow 'volume_create_manager' (ed842b9b-e880-45a8-afa9-d8b311c7c6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (448ed599-56ff-4118-9117-80efbb063cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:00 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD Jun 03 12:11:00 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (448ed599-56ff-4118-9117-80efbb063cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1092148994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3559a6f-b866-46f9-bb8b-79360d1f61a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a45f959689449487efd1606d553c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:01Z,use_quota=True,user_id='3cabb2467cd7434a9316a3eb27423bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bccb34ce-9f77-44df-9260-e861df8d5e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bccb34ce-9f77-44df-9260-e861df8d5e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3928a812-4814-465c-9bf6-6f57a880f2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3928a812-4814-465c-9bf6-6f57a880f2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3559a6f-b866-46f9-bb8b-79360d1f61a9', 'volume_name': 'volume-d3559a6f-b866-46f9-bb8b-79360d1f61a9', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb0e795-5c5b-4278-aca8-7e08dfb1666b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb0e795-5c5b-4278-aca8-7e08dfb1666b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:00 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b25649-0cf7-4c42-9f05-767a059af4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:00 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Volume d3559a6f-b866-46f9-bb8b-79360d1f61a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3559a6f-b866-46f9-bb8b-79360d1f61a9', 'volume_size': 1} Jun 03 12:11:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:00 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-354f8a32-ca3f-4927-bc8e-5a133cebe85c tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.adc8531a-35f2-455a-baf3-9bca76abe28f 1G" returned: 0 in 1.014s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-354f8a32-ca3f-4927-bc8e-5a133cebe85c tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.adc8531a-35f2-455a-baf3-9bca76abe28f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:00 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.adc8531a-35f2-455a-baf3-9bca76abe28f Jun 03 12:11:00 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Flow 'volume_create_manager' (14208583-8457-4690-bc86-f03326374f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc06a26-6f66-4a7c-8472-2d640162d0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc06a26-6f66-4a7c-8472-2d640162d0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2000796465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691632f5-0995-4df4-8afd-96306ddcd947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a45f959689449487efd1606d553c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:01Z,use_quota=True,user_id='3cabb2467cd7434a9316a3eb27423bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2690c5-c1b8-46d7-acf2-3827152a5436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2690c5-c1b8-46d7-acf2-3827152a5436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab76bbb7-7096-4bf4-9079-83346b164595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab76bbb7-7096-4bf4-9079-83346b164595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '691632f5-0995-4df4-8afd-96306ddcd947', 'volume_name': 'volume-691632f5-0995-4df4-8afd-96306ddcd947', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd80176-fbb8-49ed-a2bc-e18e2a15ebb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd80176-fbb8-49ed-a2bc-e18e2a15ebb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39732ce9-bc47-4480-a413-807ce505d5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:01 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Volume 691632f5-0995-4df4-8afd-96306ddcd947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-691632f5-0995-4df4-8afd-96306ddcd947', 'volume_size': 1} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:01 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD" returned: 1 in 0.937s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Flow 'volume_create_manager' (2c64dc53-3a3a-454d-bab9-aacb72d69206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32e37f7a-ab49-470c-99a5-dfdffd19e1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32e37f7a-ab49-470c-99a5-dfdffd19e1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-118185076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930dc6ef-5a3b-4044-9a5c-d585ae10c424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a45f959689449487efd1606d553c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:01Z,use_quota=True,user_id='3cabb2467cd7434a9316a3eb27423bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b37dc8e-15ac-4db6-b260-b6cd66c70fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b37dc8e-15ac-4db6-b260-b6cd66c70fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e5b5a5-08c2-47f0-9507-8900c7a4835d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e5b5a5-08c2-47f0-9507-8900c7a4835d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '930dc6ef-5a3b-4044-9a5c-d585ae10c424', 'volume_name': 'volume-930dc6ef-5a3b-4044-9a5c-d585ae10c424', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1261f4b-c064-4231-9021-f8bc8d8c5642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1261f4b-c064-4231-9021-f8bc8d8c5642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b55231e-4735-418b-892b-e83dc2506576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:01 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Volume 930dc6ef-5a3b-4044-9a5c-d585ae10c424: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-930dc6ef-5a3b-4044-9a5c-d585ae10c424', 'volume_size': 1} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:01 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-354f8a32-ca3f-4927-bc8e-5a133cebe85c tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.adc8531a-35f2-455a-baf3-9bca76abe28f" returned: 0 in 0.917s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:01 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-354f8a32-ca3f-4927-bc8e-5a133cebe85c tempest-CreateVolumesFromSnapshotTest-1693238937 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.adc8531a-35f2-455a-baf3-9bca76abe28f is being set with open permissions: ugo+rw Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-354f8a32-ca3f-4927-bc8e-5a133cebe85c tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.adc8531a-35f2-455a-baf3-9bca76abe28f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:01 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.adc8531a-35f2-455a-baf3-9bca76abe28f Jun 03 12:11:01 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Flow 'volume_create_manager' (fe95d072-afbb-4192-b500-3484bca9d071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7492ebf-e355-40a1-8783-e2eef4d946e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7492ebf-e355-40a1-8783-e2eef4d946e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1564343724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0324a61-bd91-4ed3-8e13-1e326085a972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a45f959689449487efd1606d553c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:02Z,use_quota=True,user_id='3cabb2467cd7434a9316a3eb27423bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aefa127-ca8c-4e52-bfa1-a33112411be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aefa127-ca8c-4e52-bfa1-a33112411be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd974e8-f7d9-426f-be0b-64244b468af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd974e8-f7d9-426f-be0b-64244b468af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0324a61-bd91-4ed3-8e13-1e326085a972', 'volume_name': 'volume-c0324a61-bd91-4ed3-8e13-1e326085a972', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09880ce4-ce9c-4b15-97ff-ff61f5c61fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09880ce4-ce9c-4b15-97ff-ff61f5c61fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b7d91b-e5cd-4c8e-95ff-2e7ffdd56aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:01 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Volume c0324a61-bd91-4ed3-8e13-1e326085a972: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0324a61-bd91-4ed3-8e13-1e326085a972', 'volume_size': 1} Jun 03 12:11:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:02 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:11:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Flow 'volume_create_manager' (67bcff95-b800-4f88-9dbc-bc63485d846b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a2569f0-38d3-48f6-8a99-60718dc1818b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a2569f0-38d3-48f6-8a99-60718dc1818b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1988567820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969009e2-fb6c-47be-b4fa-5832bd2a1917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a45f959689449487efd1606d553c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:02Z,use_quota=True,user_id='3cabb2467cd7434a9316a3eb27423bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0cf1d7-729f-4ef2-bd94-346743c1da6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0cf1d7-729f-4ef2-bd94-346743c1da6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4626b477-c6fc-42f6-ae38-e560ffd0f516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4626b477-c6fc-42f6-ae38-e560ffd0f516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '969009e2-fb6c-47be-b4fa-5832bd2a1917', 'volume_name': 'volume-969009e2-fb6c-47be-b4fa-5832bd2a1917', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d151ee1b-d293-4b49-b770-3f591d850f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d151ee1b-d293-4b49-b770-3f591d850f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:02 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8fcaa4-cecd-4430-ae5f-e61c52435e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:02 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Volume 969009e2-fb6c-47be-b4fa-5832bd2a1917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-969009e2-fb6c-47be-b4fa-5832bd2a1917', 'volume_size': 1} Jun 03 12:11:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:02 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-354f8a32-ca3f-4927-bc8e-5a133cebe85c tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.adc8531a-35f2-455a-baf3-9bca76abe28f" returned: 0 in 0.656s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-354f8a32-ca3f-4927-bc8e-5a133cebe85c tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:02 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.info Jun 03 12:11:02 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:03 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-354f8a32-ca3f-4927-bc8e-5a133cebe85c tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.info" returned: 0 in 0.612s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:03 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-354f8a32-ca3f-4927-bc8e-5a133cebe85c tempest-CreateVolumesFromSnapshotTest-1693238937 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.info is being set with open permissions: ugo+rw Jun 03 12:11:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-354f8a32-ca3f-4927-bc8e-5a133cebe85c tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:03 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.info Jun 03 12:11:03 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:03 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-354f8a32-ca3f-4927-bc8e-5a133cebe85c tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.info" returned: 0 in 0.596s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-354f8a32-ca3f-4927-bc8e-5a133cebe85c tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.649s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4262270c-96e3-4cd1-b6ab-d8ce74f3d32e tempest-VolumeDependencyTests-1714046286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.938s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:03 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-4262270c-96e3-4cd1-b6ab-d8ce74f3d32e tempest-VolumeDependencyTests-1714046286 None] Creating offline snapshot 73d69893-db8c-445e-b0bc-4659a8610bd3 of volume 64fdf3a7-7bd1-4d2e-a034-fbabac56d552 {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 12:11:03 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-354f8a32-ca3f-4927-bc8e-5a133cebe85c tempest-CreateVolumesFromSnapshotTest-1693238937 None] Create snapshot completed successfully Jun 03 12:11:03 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a8fe61-f756-4297-9bed-663fc702da68]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4262270c-96e3-4cd1-b6ab-d8ce74f3d32e tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:03 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 Jun 03 12:11:03 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Flow 'volume_create_manager' (56e541ba-0c1f-4a01-97c5-20c32850c04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99763b9-6d26-43db-af91-28b178a6304b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99763b9-6d26-43db-af91-28b178a6304b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-745164311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018d9e78-3816-448a-8426-08152fe7ae04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ada3a2cc4d41ee948c0e60022be671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:04Z,use_quota=True,user_id='70a3aab1ed29420eba7f4e410ec13852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab07515-7632-42a0-a252-329d14c99f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab07515-7632-42a0-a252-329d14c99f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886b284d-2a43-4723-9050-452c625aa537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886b284d-2a43-4723-9050-452c625aa537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '018d9e78-3816-448a-8426-08152fe7ae04', 'volume_name': 'volume-018d9e78-3816-448a-8426-08152fe7ae04', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183c2ee8-cc3c-4289-8f85-c5001de29b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183c2ee8-cc3c-4289-8f85-c5001de29b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfef83b-92ed-4c41-b7c9-efb005af8ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:04 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Volume 018d9e78-3816-448a-8426-08152fe7ae04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-018d9e78-3816-448a-8426-08152fe7ae04', 'volume_size': 1} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:04 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4262270c-96e3-4cd1-b6ab-d8ce74f3d32e tempest-VolumeDependencyTests-1714046286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552" returned: 0 in 0.763s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4262270c-96e3-4cd1-b6ab-d8ce74f3d32e tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:04 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3 1G Jun 03 12:11:04 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Flow 'volume_create_manager' (650dc494-c045-4389-8ebd-0e58063e322c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99a0980-89de-4ac5-a626-bf5405704d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99a0980-89de-4ac5-a626-bf5405704d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1895714734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4526f602-0a9c-4220-85fb-c572b77c3042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ada3a2cc4d41ee948c0e60022be671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:05Z,use_quota=True,user_id='70a3aab1ed29420eba7f4e410ec13852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72b0de8-6e26-424e-a62a-f91503f585d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72b0de8-6e26-424e-a62a-f91503f585d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed99b2b2-7ccb-425f-bf0c-6b8379e3064b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed99b2b2-7ccb-425f-bf0c-6b8379e3064b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4526f602-0a9c-4220-85fb-c572b77c3042', 'volume_name': 'volume-4526f602-0a9c-4220-85fb-c572b77c3042', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6bd805-47eb-4d55-8f10-f477d5efac26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6bd805-47eb-4d55-8f10-f477d5efac26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a637b87f-8e76-4602-be37-cc7be9fa1081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:04 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Volume 4526f602-0a9c-4220-85fb-c572b77c3042: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4526f602-0a9c-4220-85fb-c572b77c3042', 'volume_size': 1} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:11:04 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Flow 'volume_create_manager' (28d0570e-1a3c-4251-853b-658271f83a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7a3c93-0c4a-468f-9025-a6a84b4a286a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7a3c93-0c4a-468f-9025-a6a84b4a286a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-299578094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5a773fd-bc7a-4480-8aa3-dd0b475019dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ada3a2cc4d41ee948c0e60022be671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:05Z,use_quota=True,user_id='70a3aab1ed29420eba7f4e410ec13852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168bec74-e3f9-47b2-b381-62eef86426ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168bec74-e3f9-47b2-b381-62eef86426ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e27ba4-bf6e-49b7-9758-e686275116b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e27ba4-bf6e-49b7-9758-e686275116b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5a773fd-bc7a-4480-8aa3-dd0b475019dc', 'volume_name': 'volume-d5a773fd-bc7a-4480-8aa3-dd0b475019dc', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b953626-bd33-412a-a72a-e08db85f0e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b953626-bd33-412a-a72a-e08db85f0e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (860430bf-f03e-4823-954b-c97e9fbe7de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:05 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Volume d5a773fd-bc7a-4480-8aa3-dd0b475019dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5a773fd-bc7a-4480-8aa3-dd0b475019dc', 'volume_size': 1} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Flow 'volume_create_manager' (677778a8-9a0e-43d5-9b25-8eed307a16ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a14b4448-5463-436a-8cc9-3985371aa45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a14b4448-5463-436a-8cc9-3985371aa45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-592270075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b73dc7-09aa-4de3-8d3e-94dcd183dc0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ada3a2cc4d41ee948c0e60022be671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:05Z,use_quota=True,user_id='70a3aab1ed29420eba7f4e410ec13852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c6f5815-0adf-41cc-a43c-c7ce1b4c102b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c6f5815-0adf-41cc-a43c-c7ce1b4c102b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089d2695-68c8-4f15-a0a9-6b92ce3ba091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089d2695-68c8-4f15-a0a9-6b92ce3ba091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39b73dc7-09aa-4de3-8d3e-94dcd183dc0e', 'volume_name': 'volume-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b84169-3d03-41ac-bc68-46597428067b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b84169-3d03-41ac-bc68-46597428067b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8fdb8b-d806-4dfe-834f-b0a066ea1292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:05 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Volume 39b73dc7-09aa-4de3-8d3e-94dcd183dc0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e', 'volume_size': 1} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:05 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4262270c-96e3-4cd1-b6ab-d8ce74f3d32e tempest-VolumeDependencyTests-1714046286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3 1G" returned: 0 in 0.936s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4262270c-96e3-4cd1-b6ab-d8ce74f3d32e tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:05 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3 Jun 03 12:11:05 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Flow 'volume_create_manager' (0aa2bd73-74b4-4336-8b21-94d6eab2b6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cd5ad6-55f8-4741-8f76-69b8fb6d3712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cd5ad6-55f8-4741-8f76-69b8fb6d3712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-533677981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c807e84d-79ce-45c3-8efa-d736d9a4b530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ada3a2cc4d41ee948c0e60022be671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:06Z,use_quota=True,user_id='70a3aab1ed29420eba7f4e410ec13852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11149c4-5e24-43f0-9575-14a887e6e26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11149c4-5e24-43f0-9575-14a887e6e26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f22e46b-e143-43c6-aef4-a6b01e4a7351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f22e46b-e143-43c6-aef4-a6b01e4a7351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c807e84d-79ce-45c3-8efa-d736d9a4b530', 'volume_name': 'volume-c807e84d-79ce-45c3-8efa-d736d9a4b530', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca3549e-1449-4e8f-aeb2-98473c042944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca3549e-1449-4e8f-aeb2-98473c042944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01acdb8c-c738-429c-bcd4-f2ec32b71e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:05 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Volume c807e84d-79ce-45c3-8efa-d736d9a4b530: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c807e84d-79ce-45c3-8efa-d736d9a4b530', 'volume_size': 1} Jun 03 12:11:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:06 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4262270c-96e3-4cd1-b6ab-d8ce74f3d32e tempest-VolumeDependencyTests-1714046286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3" returned: 0 in 0.664s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:06 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-4262270c-96e3-4cd1-b6ab-d8ce74f3d32e tempest-VolumeDependencyTests-1714046286 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3 is being set with open permissions: ugo+rw Jun 03 12:11:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4262270c-96e3-4cd1-b6ab-d8ce74f3d32e tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:06 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3 Jun 03 12:11:06 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:06 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4262270c-96e3-4cd1-b6ab-d8ce74f3d32e tempest-VolumeDependencyTests-1714046286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3" returned: 0 in 0.612s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4262270c-96e3-4cd1-b6ab-d8ce74f3d32e tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:06 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.info Jun 03 12:11:06 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:07 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4262270c-96e3-4cd1-b6ab-d8ce74f3d32e tempest-VolumeDependencyTests-1714046286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.info" returned: 0 in 0.594s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:07 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-4262270c-96e3-4cd1-b6ab-d8ce74f3d32e tempest-VolumeDependencyTests-1714046286 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.info is being set with open permissions: ugo+rw Jun 03 12:11:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4262270c-96e3-4cd1-b6ab-d8ce74f3d32e tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:07 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.info Jun 03 12:11:07 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:08 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4262270c-96e3-4cd1-b6ab-d8ce74f3d32e tempest-VolumeDependencyTests-1714046286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.info" returned: 0 in 0.601s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4262270c-96e3-4cd1-b6ab-d8ce74f3d32e tempest-VolumeDependencyTests-1714046286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.273s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.275s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1092148994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3559a6f-b866-46f9-bb8b-79360d1f61a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a45f959689449487efd1606d553c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:01Z,use_quota=True,user_id='3cabb2467cd7434a9316a3eb27423bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Creating volume d3559a6f-b866-46f9-bb8b-79360d1f61a9 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:11:08 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3559a6f-b866-46f9-bb8b-79360d1f61a9 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:08 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3559a6f-b866-46f9-bb8b-79360d1f61a9 1073741824 Jun 03 12:11:08 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:08 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-4262270c-96e3-4cd1-b6ab-d8ce74f3d32e tempest-VolumeDependencyTests-1714046286 None] Create snapshot completed successfully Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Flow 'volume_create_manager' (b489ce55-1a95-4265-9e0c-2a42dc191dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60ffde0-8ca9-48a5-8aa2-2cbbae950c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60ffde0-8ca9-48a5-8aa2-2cbbae950c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-355987439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f7f18f-d6b0-476a-a32c-06756051fc07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b933c38111ea4b2c87db887af77e9a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=73d69893-db8c-445e-b0bc-4659a8610bd3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:09Z,use_quota=True,user_id='41cabcfeda3549509c5427eb37a467c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1069bcf0-3a6c-4abb-9448-cae597e5112d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1069bcf0-3a6c-4abb-9448-cae597e5112d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f86a349-adf9-4ac1-9c2c-d0d4f046effb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f86a349-adf9-4ac1-9c2c-d0d4f046effb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd4f7f18f-d6b0-476a-a32c-06756051fc07', 'volume_name': 'volume-d4f7f18f-d6b0-476a-a32c-06756051fc07', 'volume_size': 1, 'snapshot_id': '73d69893-db8c-445e-b0bc-4659a8610bd3'}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3040e0a-d32e-4d59-963e-ce6093f35f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3040e0a-d32e-4d59-963e-ce6093f35f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89025471-6b39-41f4-aa20-531ed3d49735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:08 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Volume d4f7f18f-d6b0-476a-a32c-06756051fc07: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d4f7f18f-d6b0-476a-a32c-06756051fc07', 'volume_size': 1, 'snapshot_id': '73d69893-db8c-445e-b0bc-4659a8610bd3'} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:08 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3559a6f-b866-46f9-bb8b-79360d1f61a9 1073741824" returned: 0 in 0.869s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3559a6f-b866-46f9-bb8b-79360d1f61a9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:08 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3559a6f-b866-46f9-bb8b-79360d1f61a9 Jun 03 12:11:08 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:09 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3559a6f-b866-46f9-bb8b-79360d1f61a9" returned: 0 in 0.603s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:11:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.321s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2000796465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691632f5-0995-4df4-8afd-96306ddcd947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a45f959689449487efd1606d553c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:01Z,use_quota=True,user_id='3cabb2467cd7434a9316a3eb27423bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:11:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Creating volume 691632f5-0995-4df4-8afd-96306ddcd947 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:11:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:09 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:11:09 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:11:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-691632f5-0995-4df4-8afd-96306ddcd947 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b25649-0cf7-4c42-9f05-767a059af4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3559a6f-b866-46f9-bb8b-79360d1f61a9', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:09 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-691632f5-0995-4df4-8afd-96306ddcd947 1073741824 Jun 03 12:11:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181130cf-6d7a-49ac-858c-6c292f894014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:09 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:09 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Volume volume-d3559a6f-b866-46f9-bb8b-79360d1f61a9 (d3559a6f-b866-46f9-bb8b-79360d1f61a9): created successfully Jun 03 12:11:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181130cf-6d7a-49ac-858c-6c292f894014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:09 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Flow 'volume_create_manager' (ed842b9b-e880-45a8-afa9-d8b311c7c6fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:09 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-3af25fb7-d466-456f-84b6-270efdfa24e5 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Created volume successfully. Jun 03 12:11:10 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-691632f5-0995-4df4-8afd-96306ddcd947 1073741824" returned: 0 in 0.790s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-691632f5-0995-4df4-8afd-96306ddcd947 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:10 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-691632f5-0995-4df4-8afd-96306ddcd947 Jun 03 12:11:10 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:11 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-691632f5-0995-4df4-8afd-96306ddcd947" returned: 0 in 0.626s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:11:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.506s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdab1034-f326-4e7d-aff4-67a56cdc34d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cecdd4806d447bdbeac466077c3e349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:10:58Z,use_quota=True,user_id='f9242b39f0134b70bb551150865bb995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7fad87a-5d1f-4618-963c-252e7a6b5eb5),volume_type_id=a7fad87a-5d1f-4618-963c-252e7a6b5eb5)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:11:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Creating volume fdab1034-f326-4e7d-aff4-67a56cdc34d7 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:11:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:11:11 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:11:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:11 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 1073741824 Jun 03 12:11:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39732ce9-bc47-4480-a413-807ce505d5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-691632f5-0995-4df4-8afd-96306ddcd947', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:11 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95748b8e-7df0-43fb-87c9-aee7ae6ec75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:11 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Volume volume-691632f5-0995-4df4-8afd-96306ddcd947 (691632f5-0995-4df4-8afd-96306ddcd947): created successfully Jun 03 12:11:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95748b8e-7df0-43fb-87c9-aee7ae6ec75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:11 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Flow 'volume_create_manager' (14208583-8457-4690-bc86-f03326374f0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:11 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-6d38b8a9-ec01-4a40-ba68-0161e59df975 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Created volume successfully. Jun 03 12:11:11 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 1073741824" returned: 0 in 0.787s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:11 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 Jun 03 12:11:11 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:12 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7" returned: 0 in 0.601s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:12 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:11:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.840s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:12 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-118185076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930dc6ef-5a3b-4044-9a5c-d585ae10c424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a45f959689449487efd1606d553c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:01Z,use_quota=True,user_id='3cabb2467cd7434a9316a3eb27423bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:11:12 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Creating volume 930dc6ef-5a3b-4044-9a5c-d585ae10c424 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:11:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:12 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:12 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:12 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:11:12 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:11:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-930dc6ef-5a3b-4044-9a5c-d585ae10c424 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:12 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-930dc6ef-5a3b-4044-9a5c-d585ae10c424 1073741824 Jun 03 12:11:12 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:12 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Attempting download of 72797c2b-f70b-4084-aa4e-37422dcfd42d ((None, [{'url': 'file:///opt/stack/data/glance/images/72797c2b-f70b-4084-aa4e-37422dcfd42d', 'metadata': {}}])) to volume fdab1034-f326-4e7d-aff4-67a56cdc34d7. {{(pid=86724) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 03 12:11:12 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e14bd75-ccd0-4111-93b8-2551628ac679]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:12 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72797c2b-f70b-4084-aa4e-37422dcfd42d_54eb2x09 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:12 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72797c2b-f70b-4084-aa4e-37422dcfd42d_54eb2x09 Jun 03 12:11:12 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:13 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-930dc6ef-5a3b-4044-9a5c-d585ae10c424 1073741824" returned: 0 in 0.797s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:13 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72797c2b-f70b-4084-aa4e-37422dcfd42d_54eb2x09" returned: 0 in 0.748s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72797c2b-f70b-4084-aa4e-37422dcfd42d_54eb2x09 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:13 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-930dc6ef-5a3b-4044-9a5c-d585ae10c424 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:13 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-930dc6ef-5a3b-4044-9a5c-d585ae10c424 Jun 03 12:11:13 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:13 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72797c2b-f70b-4084-aa4e-37422dcfd42d_54eb2x09 Jun 03 12:11:13 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:13 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-930dc6ef-5a3b-4044-9a5c-d585ae10c424" returned: 0 in 0.618s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1564343724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0324a61-bd91-4ed3-8e13-1e326085a972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a45f959689449487efd1606d553c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:02Z,use_quota=True,user_id='3cabb2467cd7434a9316a3eb27423bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Creating volume c0324a61-bd91-4ed3-8e13-1e326085a972 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:11:14 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0324a61-bd91-4ed3-8e13-1e326085a972 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:14 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0324a61-bd91-4ed3-8e13-1e326085a972 1073741824 Jun 03 12:11:14 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b55231e-4735-418b-892b-e83dc2506576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-930dc6ef-5a3b-4044-9a5c-d585ae10c424', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277b1337-66af-4fea-963e-99e8be18afb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:14 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72797c2b-f70b-4084-aa4e-37422dcfd42d_54eb2x09" returned: 1 in 0.710s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72797c2b-f70b-4084-aa4e-37422dcfd42d_54eb2x09' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fb0b38-160e-4479-9b57-79e0b0e5f471]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:14 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Volume volume-930dc6ef-5a3b-4044-9a5c-d585ae10c424 (930dc6ef-5a3b-4044-9a5c-d585ae10c424): created successfully Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277b1337-66af-4fea-963e-99e8be18afb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Flow 'volume_create_manager' (2c64dc53-3a3a-454d-bab9-aacb72d69206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:14 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-2bfeb255-a5d9-42d1-9612-d07d6bb38e9c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Created volume successfully. Jun 03 12:11:14 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD Jun 03 12:11:14 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:14 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD" returned: 0 in 0.732s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:14 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0324a61-bd91-4ed3-8e13-1e326085a972 1073741824" returned: 0 in 0.870s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:14 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD Jun 03 12:11:14 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:14 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0324a61-bd91-4ed3-8e13-1e326085a972 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:14 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0324a61-bd91-4ed3-8e13-1e326085a972 Jun 03 12:11:14 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:15 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD" returned: 1 in 0.735s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:11:15 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] 72797c2b-f70b-4084-aa4e-37422dcfd42d was raw, converting to raw {{(pid=86724) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 03 12:11:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:15 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0324a61-bd91-4ed3-8e13-1e326085a972" returned: 0 in 0.639s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:11:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.295s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1988567820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969009e2-fb6c-47be-b4fa-5832bd2a1917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a45f959689449487efd1606d553c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:02Z,use_quota=True,user_id='3cabb2467cd7434a9316a3eb27423bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:11:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Creating volume 969009e2-fb6c-47be-b4fa-5832bd2a1917 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:11:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:15 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 Jun 03 12:11:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:15 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:15 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:11:15 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:11:15 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-969009e2-fb6c-47be-b4fa-5832bd2a1917 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b7d91b-e5cd-4c8e-95ff-2e7ffdd56aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0324a61-bd91-4ed3-8e13-1e326085a972', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:15 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-969009e2-fb6c-47be-b4fa-5832bd2a1917 1073741824 Jun 03 12:11:15 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc194bd-9797-4feb-bd1c-013b4fdecd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:15 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Volume volume-c0324a61-bd91-4ed3-8e13-1e326085a972 (c0324a61-bd91-4ed3-8e13-1e326085a972): created successfully Jun 03 12:11:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc194bd-9797-4feb-bd1c-013b4fdecd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:15 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Flow 'volume_create_manager' (fe95d072-afbb-4192-b500-3484bca9d071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:15 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-1e68809d-806b-48e0-946d-96759b2d0204 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Created volume successfully. Jun 03 12:11:16 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7" returned: 0 in 0.758s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:16 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_72797c2b-f70b-4084-aa4e-37422dcfd42d_im3sj00ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 12:11:16 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Converted 0.00 MB image at 0.00 MB/s Jun 03 12:11:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:16 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 1G Jun 03 12:11:16 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:16 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-969009e2-fb6c-47be-b4fa-5832bd2a1917 1073741824" returned: 0 in 0.815s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-969009e2-fb6c-47be-b4fa-5832bd2a1917 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:16 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-969009e2-fb6c-47be-b4fa-5832bd2a1917 Jun 03 12:11:16 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:16 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:16 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 1G" returned: 0 in 0.655s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5a5cca-920f-4628-8503-12fbbbe2ce60]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:17 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-969009e2-fb6c-47be-b4fa-5832bd2a1917" returned: 0 in 0.643s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.690s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-745164311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018d9e78-3816-448a-8426-08152fe7ae04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ada3a2cc4d41ee948c0e60022be671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:04Z,use_quota=True,user_id='70a3aab1ed29420eba7f4e410ec13852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Creating volume 018d9e78-3816-448a-8426-08152fe7ae04 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:11:17 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-018d9e78-3816-448a-8426-08152fe7ae04 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:17 devstack sudo[104735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 Jun 03 12:11:17 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:17 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-018d9e78-3816-448a-8426-08152fe7ae04 1073741824 Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8fcaa4-cecd-4430-ae5f-e61c52435e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-969009e2-fb6c-47be-b4fa-5832bd2a1917', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:17 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e63e6b4-a573-42f3-904c-1fb397785159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:17 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Volume volume-969009e2-fb6c-47be-b4fa-5832bd2a1917 (969009e2-fb6c-47be-b4fa-5832bd2a1917): created successfully Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e63e6b4-a573-42f3-904c-1fb397785159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Flow 'volume_create_manager' (67bcff95-b800-4f88-9dbc-bc63485d846b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:17 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-dc99ca83-dbfd-49b7-8b25-2bba3d08a7ae tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Created volume successfully. Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d8de14e7-d4e5-437d-9cdf-1e38348e1ac0 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "cinder-969009e2-fb6c-47be-b4fa-5832bd2a1917-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d8de14e7-d4e5-437d-9cdf-1e38348e1ac0 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-969009e2-fb6c-47be-b4fa-5832bd2a1917-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d8de14e7-d4e5-437d-9cdf-1e38348e1ac0 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "cinder-quobyte-969009e2-fb6c-47be-b4fa-5832bd2a1917" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d8de14e7-d4e5-437d-9cdf-1e38348e1ac0 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-quobyte-969009e2-fb6c-47be-b4fa-5832bd2a1917" acquired by "delete_volume" :: waited 0.019s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c490295-5541-4331-b8f9-b69f3afbde3f]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d8de14e7-d4e5-437d-9cdf-1e38348e1ac0 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-969009e2-fb6c-47be-b4fa-5832bd2a1917 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:17 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7" returned: 0 in 0.779s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:17 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-969009e2-fb6c-47be-b4fa-5832bd2a1917 Jun 03 12:11:17 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:17 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 Jun 03 12:11:17 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:17 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-018d9e78-3816-448a-8426-08152fe7ae04 1073741824" returned: 0 in 0.839s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-018d9e78-3816-448a-8426-08152fe7ae04 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:18 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-018d9e78-3816-448a-8426-08152fe7ae04 Jun 03 12:11:18 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:18 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d8de14e7-d4e5-437d-9cdf-1e38348e1ac0 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-969009e2-fb6c-47be-b4fa-5832bd2a1917" returned: 0 in 0.799s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d8de14e7-d4e5-437d-9cdf-1e38348e1ac0 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-969009e2-fb6c-47be-b4fa-5832bd2a1917 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:18 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7" returned: 1 in 0.774s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Downloaded image 72797c2b-f70b-4084-aa4e-37422dcfd42d ((None, [{'url': 'file:///opt/stack/data/glance/images/72797c2b-f70b-4084-aa4e-37422dcfd42d', 'metadata': {}}])) to volume fdab1034-f326-4e7d-aff4-67a56cdc34d7 successfully. {{(pid=86724) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Temporary image 72797c2b-f70b-4084-aa4e-37422dcfd42d for user f9242b39f0134b70bb551150865bb995 is deleted. {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Marking volume fdab1034-f326-4e7d-aff4-67a56cdc34d7 as bootable. {{(pid=86724) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 03 12:11:18 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-969009e2-fb6c-47be-b4fa-5832bd2a1917 Jun 03 12:11:18 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Copying metadata from image 72797c2b-f70b-4084-aa4e-37422dcfd42d to fdab1034-f326-4e7d-aff4-67a56cdc34d7. {{(pid=86724) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Creating volume glance metadata for volume fdab1034-f326-4e7d-aff4-67a56cdc34d7 backed by image 72797c2b-f70b-4084-aa4e-37422dcfd42d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '72797c2b-f70b-4084-aa4e-37422dcfd42d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3357d06c7a45fa71ad58cfb3623972ea', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86724) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 03 12:11:18 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-018d9e78-3816-448a-8426-08152fe7ae04" returned: 0 in 0.660s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.812s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1895714734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4526f602-0a9c-4220-85fb-c572b77c3042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ada3a2cc4d41ee948c0e60022be671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:05Z,use_quota=True,user_id='70a3aab1ed29420eba7f4e410ec13852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Creating volume 4526f602-0a9c-4220-85fb-c572b77c3042 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:11:18 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4526f602-0a9c-4220-85fb-c572b77c3042 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:18 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4526f602-0a9c-4220-85fb-c572b77c3042 1073741824 Jun 03 12:11:18 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfef83b-92ed-4c41-b7c9-efb005af8ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-018d9e78-3816-448a-8426-08152fe7ae04', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386f1dd2-592f-47c2-b24b-139370094846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:18 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Volume volume-018d9e78-3816-448a-8426-08152fe7ae04 (018d9e78-3816-448a-8426-08152fe7ae04): created successfully Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386f1dd2-592f-47c2-b24b-139370094846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Flow 'volume_create_manager' (56e541ba-0c1f-4a01-97c5-20c32850c04f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8ea7b5-49d8-494d-97de-c27f0735f0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7', 'volume_size': 1, 'image_id': '72797c2b-f70b-4084-aa4e-37422dcfd42d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72797c2b-f70b-4084-aa4e-37422dcfd42d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3357d06c7a45fa71ad58cfb3623972ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4cecdd4806d447bdbeac466077c3e349', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9ce98184d9b3b905235ac67e06d49928dfb0d7935c0aedb21b881854e32e551257e738a4f8ec0e37115adf213acaa1f781ef561315e9d9ca72cef37f9dcab1e2', 'id': '72797c2b-f70b-4084-aa4e-37422dcfd42d', 'created_at': datetime.datetime(2026, 6, 3, 10, 10, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 10, 10, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72797c2b-f70b-4084-aa4e-37422dcfd42d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4821067-7c74-4d43-a78b-43e5ce778317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:18 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-7b4cf2e3-ee40-4cba-bc2c-108e6eaf882f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Created volume successfully. Jun 03 12:11:18 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Volume volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 (fdab1034-f326-4e7d-aff4-67a56cdc34d7): created successfully Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4821067-7c74-4d43-a78b-43e5ce778317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Flow 'volume_create_manager' (8fada83d-7c69-44e7-8183-07d5e17ab5e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:18 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-8b8c191a-0906-45c7-8b6c-31139b7bb9ec tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Created volume successfully. Jun 03 12:11:19 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d8de14e7-d4e5-437d-9cdf-1e38348e1ac0 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-969009e2-fb6c-47be-b4fa-5832bd2a1917" returned: 0 in 0.672s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:19 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d8de14e7-d4e5-437d-9cdf-1e38348e1ac0 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-quobyte-969009e2-fb6c-47be-b4fa-5832bd2a1917" released by "delete_volume" :: held 1.518s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:19 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-d8de14e7-d4e5-437d-9cdf-1e38348e1ac0 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Created reservations ['d744991b-e419-4ca6-8a24-291f6a5288f3', '93ca2cc8-771e-4068-8815-1e31c9e4cde8', '155b6d44-dbe7-4f14-89c3-f8e146d84c98', '1260783d-e51e-4299-b5e2-52b04876ba44'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d8de14e7-d4e5-437d-9cdf-1e38348e1ac0 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d8de14e7-d4e5-437d-9cdf-1e38348e1ac0 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d8de14e7-d4e5-437d-9cdf-1e38348e1ac0 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d8de14e7-d4e5-437d-9cdf-1e38348e1ac0 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d8de14e7-d4e5-437d-9cdf-1e38348e1ac0 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d8de14e7-d4e5-437d-9cdf-1e38348e1ac0 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:19 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:11:19 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:19 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Acquiring lock "cinder-fdab1034-f326-4e7d-aff4-67a56cdc34d7-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:19 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Lock "cinder-fdab1034-f326-4e7d-aff4-67a56cdc34d7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:19 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Acquiring lock "cinder-quobyte-fdab1034-f326-4e7d-aff4-67a56cdc34d7" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:19 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4526f602-0a9c-4220-85fb-c572b77c3042 1073741824" returned: 0 in 0.948s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:19 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Lock "cinder-quobyte-fdab1034-f326-4e7d-aff4-67a56cdc34d7" acquired by "delete_volume" :: waited 0.022s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4526f602-0a9c-4220-85fb-c572b77c3042 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:19 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14c5aff-f3c7-4be7-809a-9728b2d12dea]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:19 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4526f602-0a9c-4220-85fb-c572b77c3042 Jun 03 12:11:19 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:19 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 Jun 03 12:11:19 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:19 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-82ba0530-c60d-441c-857c-541442bdf26c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "cinder-c0324a61-bd91-4ed3-8e13-1e326085a972-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:19 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-82ba0530-c60d-441c-857c-541442bdf26c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-c0324a61-bd91-4ed3-8e13-1e326085a972-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-82ba0530-c60d-441c-857c-541442bdf26c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "cinder-quobyte-c0324a61-bd91-4ed3-8e13-1e326085a972" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-82ba0530-c60d-441c-857c-541442bdf26c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-quobyte-c0324a61-bd91-4ed3-8e13-1e326085a972" acquired by "delete_volume" :: waited 0.022s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[321796c7-adf1-4396-9d4c-763e399eefa1]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-82ba0530-c60d-441c-857c-541442bdf26c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0324a61-bd91-4ed3-8e13-1e326085a972 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:20 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d8de14e7-d4e5-437d-9cdf-1e38348e1ac0 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.749s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-d8de14e7-d4e5-437d-9cdf-1e38348e1ac0 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:11:20 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d8de14e7-d4e5-437d-9cdf-1e38348e1ac0 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Deleted volume successfully. Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d8de14e7-d4e5-437d-9cdf-1e38348e1ac0 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-969009e2-fb6c-47be-b4fa-5832bd2a1917-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:20 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0324a61-bd91-4ed3-8e13-1e326085a972 Jun 03 12:11:20 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:20 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4526f602-0a9c-4220-85fb-c572b77c3042" returned: 0 in 0.693s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.283s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-299578094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5a773fd-bc7a-4480-8aa3-dd0b475019dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ada3a2cc4d41ee948c0e60022be671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:05Z,use_quota=True,user_id='70a3aab1ed29420eba7f4e410ec13852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Creating volume d5a773fd-bc7a-4480-8aa3-dd0b475019dc {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:11:20 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d5a773fd-bc7a-4480-8aa3-dd0b475019dc 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:20 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d5a773fd-bc7a-4480-8aa3-dd0b475019dc 1073741824 Jun 03 12:11:20 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a637b87f-8e76-4602-be37-cc7be9fa1081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4526f602-0a9c-4220-85fb-c572b77c3042', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90585c6a-20a6-48b6-a114-1aca22e3242a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:20 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Volume volume-4526f602-0a9c-4220-85fb-c572b77c3042 (4526f602-0a9c-4220-85fb-c572b77c3042): created successfully Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90585c6a-20a6-48b6-a114-1aca22e3242a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Flow 'volume_create_manager' (650dc494-c045-4389-8ebd-0e58063e322c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:20 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-eb6815da-c1c2-4bb8-82a7-f56ec9665fef tempest-CreateVolumesFromSnapshotTest-1693238937 None] Created volume successfully. Jun 03 12:11:20 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7" returned: 0 in 0.826s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:20 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 Jun 03 12:11:20 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:20 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-82ba0530-c60d-441c-857c-541442bdf26c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0324a61-bd91-4ed3-8e13-1e326085a972" returned: 0 in 0.854s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-82ba0530-c60d-441c-857c-541442bdf26c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0324a61-bd91-4ed3-8e13-1e326085a972 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:20 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0324a61-bd91-4ed3-8e13-1e326085a972 Jun 03 12:11:20 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:21 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d5a773fd-bc7a-4480-8aa3-dd0b475019dc 1073741824" returned: 0 in 0.860s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:21 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7" returned: 1 in 0.742s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:21 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7 Jun 03 12:11:21 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d5a773fd-bc7a-4480-8aa3-dd0b475019dc {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:21 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d5a773fd-bc7a-4480-8aa3-dd0b475019dc Jun 03 12:11:21 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:21 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-82ba0530-c60d-441c-857c-541442bdf26c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c0324a61-bd91-4ed3-8e13-1e326085a972" returned: 0 in 0.651s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-82ba0530-c60d-441c-857c-541442bdf26c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-quobyte-c0324a61-bd91-4ed3-8e13-1e326085a972" released by "delete_volume" :: held 1.556s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-82ba0530-c60d-441c-857c-541442bdf26c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Created reservations ['78800553-e124-4c44-ae7e-a45283c32f21', 'ed3309dc-4fb8-4b98-98ac-99ca9b23629f', '5f0dab39-4b54-43c9-bae7-9dd9ed66bc22', '871db42b-155d-4adc-b8c2-8e9f7759d850'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-82ba0530-c60d-441c-857c-541442bdf26c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-82ba0530-c60d-441c-857c-541442bdf26c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-82ba0530-c60d-441c-857c-541442bdf26c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-82ba0530-c60d-441c-857c-541442bdf26c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-82ba0530-c60d-441c-857c-541442bdf26c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-82ba0530-c60d-441c-857c-541442bdf26c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:21 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:11:21 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:21 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-fdab1034-f326-4e7d-aff4-67a56cdc34d7" returned: 0 in 0.641s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Lock "cinder-quobyte-fdab1034-f326-4e7d-aff4-67a56cdc34d7" released by "delete_volume" :: held 2.287s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Created reservations ['271d10a2-3048-4ee9-9879-ab6ecdd4b335', '4557f5f9-d481-4868-87f9-0006142da425', 'bd2da7d6-86a5-4948-9f96-86c1abb63ab1', 'c66781d0-305d-4942-9e34-587727bb3920'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:21 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d5a773fd-bc7a-4480-8aa3-dd0b475019dc" returned: 0 in 0.671s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.565s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-592270075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b73dc7-09aa-4de3-8d3e-94dcd183dc0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ada3a2cc4d41ee948c0e60022be671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:05Z,use_quota=True,user_id='70a3aab1ed29420eba7f4e410ec13852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Creating volume 39b73dc7-09aa-4de3-8d3e-94dcd183dc0e {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:11:21 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:11:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:22 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e 1073741824 Jun 03 12:11:22 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (860430bf-f03e-4823-954b-c97e9fbe7de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5a773fd-bc7a-4480-8aa3-dd0b475019dc', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2c536f-eb7b-49cb-82a0-0eb162531326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:22 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Volume volume-d5a773fd-bc7a-4480-8aa3-dd0b475019dc (d5a773fd-bc7a-4480-8aa3-dd0b475019dc): created successfully Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2c536f-eb7b-49cb-82a0-0eb162531326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Flow 'volume_create_manager' (28d0570e-1a3c-4251-853b-658271f83a19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:22 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d920d27c-c1c8-4443-a90f-c9084382105f tempest-CreateVolumesFromSnapshotTest-1693238937 None] Created volume successfully. Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:22 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:11:22 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-15aed926-4dc5-4910-85df-9b79ad4e61d4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "cinder-930dc6ef-5a3b-4044-9a5c-d585ae10c424-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-15aed926-4dc5-4910-85df-9b79ad4e61d4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-930dc6ef-5a3b-4044-9a5c-d585ae10c424-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-15aed926-4dc5-4910-85df-9b79ad4e61d4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "cinder-quobyte-930dc6ef-5a3b-4044-9a5c-d585ae10c424" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-15aed926-4dc5-4910-85df-9b79ad4e61d4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-quobyte-930dc6ef-5a3b-4044-9a5c-d585ae10c424" acquired by "delete_volume" :: waited 0.018s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef6c6ce-dca5-410b-862f-d43a3ecc272b]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-15aed926-4dc5-4910-85df-9b79ad4e61d4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-930dc6ef-5a3b-4044-9a5c-d585ae10c424 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:22 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-82ba0530-c60d-441c-857c-541442bdf26c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.783s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:22 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-930dc6ef-5a3b-4044-9a5c-d585ae10c424 Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-82ba0530-c60d-441c-857c-541442bdf26c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:11:22 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:22 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-82ba0530-c60d-441c-857c-541442bdf26c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Deleted volume successfully. Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-82ba0530-c60d-441c-857c-541442bdf26c tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-c0324a61-bd91-4ed3-8e13-1e326085a972-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:22 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.686s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:11:22 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Deleted volume successfully. Jun 03 12:11:22 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-0ca2ae3f-d119-48aa-80f4-01d934c4fd15 tempest-VolumeAndVolumeTypeFromImageTest-271834594 None] Lock "cinder-fdab1034-f326-4e7d-aff4-67a56cdc34d7-delete_volume" released by "delete_volume" :: held 3.278s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e 1073741824" returned: 0 in 0.841s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:22 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e Jun 03 12:11:22 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:23 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-15aed926-4dc5-4910-85df-9b79ad4e61d4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-930dc6ef-5a3b-4044-9a5c-d585ae10c424" returned: 0 in 0.838s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-15aed926-4dc5-4910-85df-9b79ad4e61d4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-930dc6ef-5a3b-4044-9a5c-d585ae10c424 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:23 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-930dc6ef-5a3b-4044-9a5c-d585ae10c424 Jun 03 12:11:23 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:23 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e" returned: 0 in 0.672s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.758s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-533677981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c807e84d-79ce-45c3-8efa-d736d9a4b530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ada3a2cc4d41ee948c0e60022be671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:06Z,use_quota=True,user_id='70a3aab1ed29420eba7f4e410ec13852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Creating volume c807e84d-79ce-45c3-8efa-d736d9a4b530 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:11:23 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c807e84d-79ce-45c3-8efa-d736d9a4b530 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:23 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c807e84d-79ce-45c3-8efa-d736d9a4b530 1073741824 Jun 03 12:11:23 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8fdb8b-d806-4dfe-834f-b0a066ea1292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ff8d53-8ce2-43f0-9e44-68f55ff6c092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:23 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Volume volume-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e (39b73dc7-09aa-4de3-8d3e-94dcd183dc0e): created successfully Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ff8d53-8ce2-43f0-9e44-68f55ff6c092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Flow 'volume_create_manager' (677778a8-9a0e-43d5-9b25-8eed307a16ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:23 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-0491834c-b4e9-49b1-a11e-d893d2759f6b tempest-CreateVolumesFromSnapshotTest-1693238937 None] Created volume successfully. Jun 03 12:11:23 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-15aed926-4dc5-4910-85df-9b79ad4e61d4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-930dc6ef-5a3b-4044-9a5c-d585ae10c424" returned: 0 in 0.694s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-15aed926-4dc5-4910-85df-9b79ad4e61d4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-quobyte-930dc6ef-5a3b-4044-9a5c-d585ae10c424" released by "delete_volume" :: held 1.587s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:23 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-15aed926-4dc5-4910-85df-9b79ad4e61d4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Created reservations ['a9cdf00b-8714-4ff7-819b-6d4337ace080', '6483638f-91f0-4ec1-b27b-b3f51f31f4ae', '1ccf6910-57cd-48fc-b48e-d6b08abb27ef', 'af8aea23-6205-49d2-b968-a9a3e352f26a'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-15aed926-4dc5-4910-85df-9b79ad4e61d4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-15aed926-4dc5-4910-85df-9b79ad4e61d4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-15aed926-4dc5-4910-85df-9b79ad4e61d4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-15aed926-4dc5-4910-85df-9b79ad4e61d4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-15aed926-4dc5-4910-85df-9b79ad4e61d4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-15aed926-4dc5-4910-85df-9b79ad4e61d4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:24 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:11:24 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5ec2feb0-575b-4ea3-b80a-8f5ba24df1ef tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "cinder-691632f5-0995-4df4-8afd-96306ddcd947-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5ec2feb0-575b-4ea3-b80a-8f5ba24df1ef tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-691632f5-0995-4df4-8afd-96306ddcd947-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:24 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c807e84d-79ce-45c3-8efa-d736d9a4b530 1073741824" returned: 0 in 0.983s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5ec2feb0-575b-4ea3-b80a-8f5ba24df1ef tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "cinder-quobyte-691632f5-0995-4df4-8afd-96306ddcd947" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c807e84d-79ce-45c3-8efa-d736d9a4b530 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5ec2feb0-575b-4ea3-b80a-8f5ba24df1ef tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-quobyte-691632f5-0995-4df4-8afd-96306ddcd947" acquired by "delete_volume" :: waited 0.045s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:24 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c807e84d-79ce-45c3-8efa-d736d9a4b530 Jun 03 12:11:24 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:24 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6973aaf9-9953-4d36-9e6d-0e9c2d379ea6]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5ec2feb0-575b-4ea3-b80a-8f5ba24df1ef tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-691632f5-0995-4df4-8afd-96306ddcd947 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:24 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-691632f5-0995-4df4-8afd-96306ddcd947 Jun 03 12:11:24 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:24 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-15aed926-4dc5-4910-85df-9b79ad4e61d4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.775s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:24 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-15aed926-4dc5-4910-85df-9b79ad4e61d4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:11:24 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-15aed926-4dc5-4910-85df-9b79ad4e61d4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Deleted volume successfully. Jun 03 12:11:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-15aed926-4dc5-4910-85df-9b79ad4e61d4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-930dc6ef-5a3b-4044-9a5c-d585ae10c424-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:25 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c807e84d-79ce-45c3-8efa-d736d9a4b530" returned: 0 in 0.720s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 16.546s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Acquiring lock "cinder-quobyte-73d69893-db8c-445e-b0bc-4659a8610bd3-d4f7f18f-d6b0-476a-a32c-06756051fc07" by "_create_volume_from_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01acdb8c-c738-429c-bcd4-f2ec32b71e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c807e84d-79ce-45c3-8efa-d736d9a4b530', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984c08ed-eafd-4e36-a984-7faf88163743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Lock "cinder-quobyte-73d69893-db8c-445e-b0bc-4659a8610bd3-d4f7f18f-d6b0-476a-a32c-06756051fc07" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Creating volume d4f7f18f-d6b0-476a-a32c-06756051fc07 from snapshot 73d69893-db8c-445e-b0bc-4659a8610bd3 {{(pid=86724) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Acquiring lock "cinder-quobyte-d4f7f18f-d6b0-476a-a32c-06756051fc07" by "_copy_volume_from_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:25 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Volume volume-c807e84d-79ce-45c3-8efa-d736d9a4b530 (c807e84d-79ce-45c3-8efa-d736d9a4b530): created successfully Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984c08ed-eafd-4e36-a984-7faf88163743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Flow 'volume_create_manager' (0aa2bd73-74b4-4336-8b21-94d6eab2b6c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Lock "cinder-quobyte-d4f7f18f-d6b0-476a-a32c-06756051fc07" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] snapshot: 73d69893-db8c-445e-b0bc-4659a8610bd3, volume: d4f7f18f-d6b0-476a-a32c-06756051fc07, {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 12:11:25 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-2118bfb4-a1ed-4ab5-962a-6d6ce11d28d0 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Created volume successfully. Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[616c413c-08c5-428c-bf97-0a62bb40c136]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:25 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5ec2feb0-575b-4ea3-b80a-8f5ba24df1ef tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-691632f5-0995-4df4-8afd-96306ddcd947" returned: 0 in 0.924s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5ec2feb0-575b-4ea3-b80a-8f5ba24df1ef tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-691632f5-0995-4df4-8afd-96306ddcd947 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:25 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-691632f5-0995-4df4-8afd-96306ddcd947 Jun 03 12:11:25 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:25 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3 Jun 03 12:11:25 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:26 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5ec2feb0-575b-4ea3-b80a-8f5ba24df1ef tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-691632f5-0995-4df4-8afd-96306ddcd947" returned: 0 in 0.731s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5ec2feb0-575b-4ea3-b80a-8f5ba24df1ef tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-quobyte-691632f5-0995-4df4-8afd-96306ddcd947" released by "delete_volume" :: held 1.720s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2830dd7f-fb79-41bf-b2e9-0ccbc77ab4fb tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "cinder-c807e84d-79ce-45c3-8efa-d736d9a4b530-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:26 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3" returned: 0 in 0.856s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] will copy from snapshot at /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Creating direct copy from snapshot {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2830dd7f-fb79-41bf-b2e9-0ccbc77ab4fb tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-c807e84d-79ce-45c3-8efa-d736d9a4b530-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cd5985-782e-4ca7-aa5c-119ff265d458]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-5ec2feb0-575b-4ea3-b80a-8f5ba24df1ef tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Created reservations ['d844854c-38c0-4e5f-a445-91acab4cf621', 'e90f9c3a-41dd-400b-abfd-dbbb6b9321a3', '59bdffe7-5687-49a4-9356-a4e3a317e031', '6b53c20b-22de-46fd-a5d0-d2138f112df7'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2830dd7f-fb79-41bf-b2e9-0ccbc77ab4fb tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "cinder-quobyte-c807e84d-79ce-45c3-8efa-d736d9a4b530" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2830dd7f-fb79-41bf-b2e9-0ccbc77ab4fb tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-quobyte-c807e84d-79ce-45c3-8efa-d736d9a4b530" acquired by "delete_volume" :: waited 0.024s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdff040-c5b9-49bf-8a37-a5cd440ca196]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2830dd7f-fb79-41bf-b2e9-0ccbc77ab4fb tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c807e84d-79ce-45c3-8efa-d736d9a4b530 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5ec2feb0-575b-4ea3-b80a-8f5ba24df1ef tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5ec2feb0-575b-4ea3-b80a-8f5ba24df1ef tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5ec2feb0-575b-4ea3-b80a-8f5ba24df1ef tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:26 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 Jun 03 12:11:26 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5ec2feb0-575b-4ea3-b80a-8f5ba24df1ef tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5ec2feb0-575b-4ea3-b80a-8f5ba24df1ef tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5ec2feb0-575b-4ea3-b80a-8f5ba24df1ef tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:26 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:11:26 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:26 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c807e84d-79ce-45c3-8efa-d736d9a4b530 Jun 03 12:11:26 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-615ddd39-f67c-453a-b162-b76901e1f8db tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "cinder-d3559a6f-b866-46f9-bb8b-79360d1f61a9-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-615ddd39-f67c-453a-b162-b76901e1f8db tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-d3559a6f-b866-46f9-bb8b-79360d1f61a9-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-615ddd39-f67c-453a-b162-b76901e1f8db tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "cinder-quobyte-d3559a6f-b866-46f9-bb8b-79360d1f61a9" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-615ddd39-f67c-453a-b162-b76901e1f8db tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-quobyte-d3559a6f-b866-46f9-bb8b-79360d1f61a9" acquired by "delete_volume" :: waited 0.028s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:26 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37c0680-1769-4ef5-980f-ab391bf44e57]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-615ddd39-f67c-453a-b162-b76901e1f8db tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3559a6f-b866-46f9-bb8b-79360d1f61a9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:27 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3559a6f-b866-46f9-bb8b-79360d1f61a9 Jun 03 12:11:27 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:27 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552" returned: 0 in 1.015s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:27 devstack cinder-volume[86724]: DEBUG cinder.utils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Path /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4f7f18f-d6b0-476a-a32c-06756051fc07 not found in is_blk_device check {{(pid=86724) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 03 12:11:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4f7f18f-d6b0-476a-a32c-06756051fc07 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:27 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5ec2feb0-575b-4ea3-b80a-8f5ba24df1ef tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.894s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:27 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5ec2feb0-575b-4ea3-b80a-8f5ba24df1ef tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:11:27 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4f7f18f-d6b0-476a-a32c-06756051fc07 Jun 03 12:11:27 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:27 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-5ec2feb0-575b-4ea3-b80a-8f5ba24df1ef tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Deleted volume successfully. Jun 03 12:11:27 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5ec2feb0-575b-4ea3-b80a-8f5ba24df1ef tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-691632f5-0995-4df4-8afd-96306ddcd947-delete_volume" released by "delete_volume" :: held 2.995s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:27 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2830dd7f-fb79-41bf-b2e9-0ccbc77ab4fb tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c807e84d-79ce-45c3-8efa-d736d9a4b530" returned: 0 in 1.065s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:27 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2830dd7f-fb79-41bf-b2e9-0ccbc77ab4fb tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c807e84d-79ce-45c3-8efa-d736d9a4b530 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:27 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c807e84d-79ce-45c3-8efa-d736d9a4b530 Jun 03 12:11:27 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:28 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-615ddd39-f67c-453a-b162-b76901e1f8db tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3559a6f-b866-46f9-bb8b-79360d1f61a9" returned: 0 in 1.119s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-615ddd39-f67c-453a-b162-b76901e1f8db tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3559a6f-b866-46f9-bb8b-79360d1f61a9 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:28 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3559a6f-b866-46f9-bb8b-79360d1f61a9 Jun 03 12:11:28 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:28 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:11:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Flow 'volume_create_manager' (49bbf2c0-6f89-4aae-9cd6-e6d8a9e448f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8477d5fc-60c0-407e-8b8a-6e9e68ec0ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8477d5fc-60c0-407e-8b8a-6e9e68ec0ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2080302294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6952a5-ed89-402d-a55b-01a34b9c7663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb0e28f5c34431d9b3e04e5c45512cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:28Z,use_quota=True,user_id='ee5de16c5cfd49f1b90caea3d969ad9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685feb85-306c-4176-9f77-7173c5b706bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685feb85-306c-4176-9f77-7173c5b706bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36e92ca-cb2c-4894-8e8f-fdf987782769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36e92ca-cb2c-4894-8e8f-fdf987782769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e6952a5-ed89-402d-a55b-01a34b9c7663', 'volume_name': 'volume-1e6952a5-ed89-402d-a55b-01a34b9c7663', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (728aebfd-5e7c-4b2b-ac01-c78a3e135671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (728aebfd-5e7c-4b2b-ac01-c78a3e135671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:28 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eba592f-45a2-4be9-a5f3-8188a686dfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:28 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Volume 1e6952a5-ed89-402d-a55b-01a34b9c7663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e6952a5-ed89-402d-a55b-01a34b9c7663', 'volume_size': 1} Jun 03 12:11:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:28 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:28 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2830dd7f-fb79-41bf-b2e9-0ccbc77ab4fb tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c807e84d-79ce-45c3-8efa-d736d9a4b530" returned: 0 in 1.105s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:28 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2830dd7f-fb79-41bf-b2e9-0ccbc77ab4fb tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-quobyte-c807e84d-79ce-45c3-8efa-d736d9a4b530" released by "delete_volume" :: held 2.282s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:29 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-2830dd7f-fb79-41bf-b2e9-0ccbc77ab4fb tempest-CreateVolumesFromSnapshotTest-1693238937 None] Created reservations ['8cf8e7f5-7d0f-4b71-b5fd-9053eba38a27', 'cc0fa635-9b66-4df5-85a4-663b07f22371', '2fb64de4-f98c-4f56-ad39-3a1cbc9429f5', '99814d7d-a9fb-4463-aaf7-f754838abc5e'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:29 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:11:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Flow 'volume_create_manager' (5636fc58-24b6-4b5f-be2d-774e53036d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d8d859-f502-4e92-bd6b-aec4a351f3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d8d859-f502-4e92-bd6b-aec4a351f3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1577486446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f48391f3-0b6e-4c9e-a7da-0ace036e1702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb0e28f5c34431d9b3e04e5c45512cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:29Z,use_quota=True,user_id='ee5de16c5cfd49f1b90caea3d969ad9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a928661-9de8-4f0a-bb90-a9989f3e90af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a928661-9de8-4f0a-bb90-a9989f3e90af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62477167-e68d-4b47-bc62-006a70819026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62477167-e68d-4b47-bc62-006a70819026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f48391f3-0b6e-4c9e-a7da-0ace036e1702', 'volume_name': 'volume-f48391f3-0b6e-4c9e-a7da-0ace036e1702', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a407148-fc87-4dbc-8a06-4e382cb45178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a407148-fc87-4dbc-8a06-4e382cb45178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:29 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c7f49e-1e90-4e31-8dc4-b62c0af89c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:29 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Volume f48391f3-0b6e-4c9e-a7da-0ace036e1702: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f48391f3-0b6e-4c9e-a7da-0ace036e1702', 'volume_size': 1} Jun 03 12:11:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2830dd7f-fb79-41bf-b2e9-0ccbc77ab4fb tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2830dd7f-fb79-41bf-b2e9-0ccbc77ab4fb tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:29 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2830dd7f-fb79-41bf-b2e9-0ccbc77ab4fb tempest-CreateVolumesFromSnapshotTest-1693238937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:29 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2830dd7f-fb79-41bf-b2e9-0ccbc77ab4fb tempest-CreateVolumesFromSnapshotTest-1693238937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2830dd7f-fb79-41bf-b2e9-0ccbc77ab4fb tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2830dd7f-fb79-41bf-b2e9-0ccbc77ab4fb tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:29 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:29 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-615ddd39-f67c-453a-b162-b76901e1f8db tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d3559a6f-b866-46f9-bb8b-79360d1f61a9" returned: 0 in 1.701s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:29 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:11:29 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-615ddd39-f67c-453a-b162-b76901e1f8db tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-quobyte-d3559a6f-b866-46f9-bb8b-79360d1f61a9" released by "delete_volume" :: held 2.931s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:29 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-615ddd39-f67c-453a-b162-b76901e1f8db tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Created reservations ['5ba71666-c9e2-474d-a369-0f16a47b509f', 'e439c3b5-8af7-4884-be45-ee5b0ca42be5', 'f5583bb9-2ab6-478f-95d7-b36a66abe9ce', '289b3420-22ff-4434-b809-10dd8a04d39c'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a262c27c-9dfd-4068-863a-be7ed50f0ab4 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "cinder-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Flow 'volume_create_manager' (dd763145-bc1e-4b27-be8a-57639a1a6ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95470ec0-5d8b-4734-85b1-abef088fa64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95470ec0-5d8b-4734-85b1-abef088fa64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1574825909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb0e28f5c34431d9b3e04e5c45512cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:30Z,use_quota=True,user_id='ee5de16c5cfd49f1b90caea3d969ad9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced0a95b-9118-40eb-b1f8-410b72825c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced0a95b-9118-40eb-b1f8-410b72825c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c87e8f-584a-4eee-a3fb-84b2f7cedea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c87e8f-584a-4eee-a3fb-84b2f7cedea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a', 'volume_name': 'volume-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3c5152-b501-4f86-941d-c1f1087c89d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3c5152-b501-4f86-941d-c1f1087c89d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0fe1a2-5bed-436b-9d19-2c97dada88e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:30 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Volume 20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a', 'volume_size': 1} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a262c27c-9dfd-4068-863a-be7ed50f0ab4 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e-delete_volume" acquired by "delete_volume" :: waited 0.328s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-615ddd39-f67c-453a-b162-b76901e1f8db tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-615ddd39-f67c-453a-b162-b76901e1f8db tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-615ddd39-f67c-453a-b162-b76901e1f8db tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-615ddd39-f67c-453a-b162-b76901e1f8db tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-615ddd39-f67c-453a-b162-b76901e1f8db tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-615ddd39-f67c-453a-b162-b76901e1f8db tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a262c27c-9dfd-4068-863a-be7ed50f0ab4 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "cinder-quobyte-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:30 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:11:30 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a262c27c-9dfd-4068-863a-be7ed50f0ab4 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-quobyte-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e" acquired by "delete_volume" :: waited 0.040s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb3eadd-9d8c-44d2-b11a-c67dd5006644]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a262c27c-9dfd-4068-863a-be7ed50f0ab4 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:31 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7afa5421-d3dc-4081-b7d3-32747551feb4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "cinder-87b68ef9-9fb7-410c-a878-1ba50669264a-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:31 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7afa5421-d3dc-4081-b7d3-32747551feb4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-87b68ef9-9fb7-410c-a878-1ba50669264a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:31 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7afa5421-d3dc-4081-b7d3-32747551feb4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "cinder-quobyte-87b68ef9-9fb7-410c-a878-1ba50669264a" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:31 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7afa5421-d3dc-4081-b7d3-32747551feb4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-quobyte-87b68ef9-9fb7-410c-a878-1ba50669264a" acquired by "delete_volume" :: waited 0.024s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:31 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e Jun 03 12:11:31 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:31 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3719d65-79dc-47b8-8b3d-1c1c86c99ce3]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7afa5421-d3dc-4081-b7d3-32747551feb4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-87b68ef9-9fb7-410c-a878-1ba50669264a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:31 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2830dd7f-fb79-41bf-b2e9-0ccbc77ab4fb tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.644s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:31 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-2830dd7f-fb79-41bf-b2e9-0ccbc77ab4fb tempest-CreateVolumesFromSnapshotTest-1693238937 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:11:31 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-2830dd7f-fb79-41bf-b2e9-0ccbc77ab4fb tempest-CreateVolumesFromSnapshotTest-1693238937 None] Deleted volume successfully. Jun 03 12:11:31 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2830dd7f-fb79-41bf-b2e9-0ccbc77ab4fb tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-c807e84d-79ce-45c3-8efa-d736d9a4b530-delete_volume" released by "delete_volume" :: held 5.161s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:31 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-87b68ef9-9fb7-410c-a878-1ba50669264a Jun 03 12:11:31 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:32 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:11:32 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Flow 'volume_create_manager' (52371453-ed27-4f24-92ac-466c029c217d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:32 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb5e09a-6fc6-4b1c-9844-271040043243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:32 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb5e09a-6fc6-4b1c-9844-271040043243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-23888634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19b6a69-b3bd-415b-93f0-628d44039613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb0e28f5c34431d9b3e04e5c45512cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:32Z,use_quota=True,user_id='ee5de16c5cfd49f1b90caea3d969ad9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:32 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1806a6cb-569b-4916-8209-2aab0fcdd63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:32 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1806a6cb-569b-4916-8209-2aab0fcdd63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:32 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0dda974-6880-43d6-8dd3-0a8de9bc93bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:32 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0dda974-6880-43d6-8dd3-0a8de9bc93bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c19b6a69-b3bd-415b-93f0-628d44039613', 'volume_name': 'volume-c19b6a69-b3bd-415b-93f0-628d44039613', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:32 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a57b86-84cf-4ee9-bcf3-2a24a9092fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:32 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a57b86-84cf-4ee9-bcf3-2a24a9092fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:32 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241fd0ff-0c5a-4499-afc7-1841119635f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:32 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Volume c19b6a69-b3bd-415b-93f0-628d44039613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c19b6a69-b3bd-415b-93f0-628d44039613', 'volume_size': 1} Jun 03 12:11:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:32 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-615ddd39-f67c-453a-b162-b76901e1f8db tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 2.151s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:32 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-615ddd39-f67c-453a-b162-b76901e1f8db tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:11:32 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-615ddd39-f67c-453a-b162-b76901e1f8db tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Deleted volume successfully. Jun 03 12:11:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-615ddd39-f67c-453a-b162-b76901e1f8db tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-d3559a6f-b866-46f9-bb8b-79360d1f61a9-delete_volume" released by "delete_volume" :: held 6.120s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:33 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a262c27c-9dfd-4068-863a-be7ed50f0ab4 tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e" returned: 0 in 2.518s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a262c27c-9dfd-4068-863a-be7ed50f0ab4 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:33 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:11:33 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e Jun 03 12:11:33 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Flow 'volume_create_manager' (f1b57ffd-e933-44f3-8a7b-d055e77c2783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:33 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:33 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6542ba90-76bc-421c-9df3-7b3511c6bc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:33 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6542ba90-76bc-421c-9df3-7b3511c6bc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-800176927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b98abed-184f-464d-8add-8f1f1fb07886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb0e28f5c34431d9b3e04e5c45512cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:33Z,use_quota=True,user_id='ee5de16c5cfd49f1b90caea3d969ad9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:33 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d6b445-5b46-451d-95e1-01a0bfeb0fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:33 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d6b445-5b46-451d-95e1-01a0bfeb0fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:33 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc3e38c9-9e79-4b2a-8e30-b4faa3d6db29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:33 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc3e38c9-9e79-4b2a-8e30-b4faa3d6db29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b98abed-184f-464d-8add-8f1f1fb07886', 'volume_name': 'volume-2b98abed-184f-464d-8add-8f1f1fb07886', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:33 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665a8b62-348a-47b7-9dee-e20eb90e0ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:33 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665a8b62-348a-47b7-9dee-e20eb90e0ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:33 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be93b83d-3f08-4903-8a22-62945dbd288a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:33 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Volume 2b98abed-184f-464d-8add-8f1f1fb07886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b98abed-184f-464d-8add-8f1f1fb07886', 'volume_size': 1} Jun 03 12:11:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:33 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7afa5421-d3dc-4081-b7d3-32747551feb4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-87b68ef9-9fb7-410c-a878-1ba50669264a" returned: 0 in 2.472s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7afa5421-d3dc-4081-b7d3-32747551feb4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-87b68ef9-9fb7-410c-a878-1ba50669264a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:33 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-87b68ef9-9fb7-410c-a878-1ba50669264a Jun 03 12:11:33 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4f7f18f-d6b0-476a-a32c-06756051fc07" returned: 0 in 7.081s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:34 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdbea76-ba68-4db9-adc6-f92539166e9e]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:34 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 Jun 03 12:11:34 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:34 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a262c27c-9dfd-4068-863a-be7ed50f0ab4 tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e" returned: 0 in 1.266s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a262c27c-9dfd-4068-863a-be7ed50f0ab4 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-quobyte-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e" released by "delete_volume" :: held 3.893s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:34 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-a262c27c-9dfd-4068-863a-be7ed50f0ab4 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Created reservations ['8aea8ea3-beea-4191-bec7-042d5c88f665', '169f7fe4-c48d-48e5-98ff-123c7a696a0d', '61318f5e-1bf7-47c5-99cc-18778e9b063c', 'fc507273-b91d-400e-a918-9b09e4d0eff5'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:34 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7afa5421-d3dc-4081-b7d3-32747551feb4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-87b68ef9-9fb7-410c-a878-1ba50669264a" returned: 0 in 0.947s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:34 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7afa5421-d3dc-4081-b7d3-32747551feb4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-quobyte-87b68ef9-9fb7-410c-a878-1ba50669264a" released by "delete_volume" :: held 3.519s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a262c27c-9dfd-4068-863a-be7ed50f0ab4 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a262c27c-9dfd-4068-863a-be7ed50f0ab4 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:34 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a262c27c-9dfd-4068-863a-be7ed50f0ab4 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:34 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a262c27c-9dfd-4068-863a-be7ed50f0ab4 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a262c27c-9dfd-4068-863a-be7ed50f0ab4 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a262c27c-9dfd-4068-863a-be7ed50f0ab4 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:34 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:11:34 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:34 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-7afa5421-d3dc-4081-b7d3-32747551feb4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Created reservations ['683ef0f6-7cae-4265-b705-218d5943e368', '71d31494-cdec-4bb7-b1f3-9a2f1089e6bb', '98434ac8-356f-42e7-a926-c2cef6cb4b7b', '140189d5-751a-438a-9fd3-8a8cb181b075'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7afa5421-d3dc-4081-b7d3-32747551feb4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7afa5421-d3dc-4081-b7d3-32747551feb4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:34 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7afa5421-d3dc-4081-b7d3-32747551feb4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:34 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7afa5421-d3dc-4081-b7d3-32747551feb4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7afa5421-d3dc-4081-b7d3-32747551feb4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7afa5421-d3dc-4081-b7d3-32747551feb4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:34 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:11:34 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:35 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-95b59e77-7a81-42dc-a12b-748eccaed1cf tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "cinder-d5a773fd-bc7a-4480-8aa3-dd0b475019dc-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:35 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-95b59e77-7a81-42dc-a12b-748eccaed1cf tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-d5a773fd-bc7a-4480-8aa3-dd0b475019dc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:35 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a262c27c-9dfd-4068-863a-be7ed50f0ab4 tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.676s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:35 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-95b59e77-7a81-42dc-a12b-748eccaed1cf tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "cinder-quobyte-d5a773fd-bc7a-4480-8aa3-dd0b475019dc" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:35 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-a262c27c-9dfd-4068-863a-be7ed50f0ab4 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:11:35 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a262c27c-9dfd-4068-863a-be7ed50f0ab4 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Deleted volume successfully. Jun 03 12:11:35 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-95b59e77-7a81-42dc-a12b-748eccaed1cf tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-quobyte-d5a773fd-bc7a-4480-8aa3-dd0b475019dc" acquired by "delete_volume" :: waited 0.040s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:35 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a262c27c-9dfd-4068-863a-be7ed50f0ab4 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-39b73dc7-09aa-4de3-8d3e-94dcd183dc0e-delete_volume" released by "delete_volume" :: held 4.957s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:35 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68ae62d-f461-4a8c-8430-69d9c63c949c]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-95b59e77-7a81-42dc-a12b-748eccaed1cf tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d5a773fd-bc7a-4480-8aa3-dd0b475019dc {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:35 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552" returned: 0 in 1.078s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:35 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Image conversion details: src /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552, size 1024.00 MB, duration 7.08 sec, destination /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4f7f18f-d6b0-476a-a32c-06756051fc07 {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 12:11:35 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Converted 1024.00 MB image at 144.59 MB/s Jun 03 12:11:35 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4f7f18f-d6b0-476a-a32c-06756051fc07 is being set with open permissions: ugo+rw Jun 03 12:11:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4f7f18f-d6b0-476a-a32c-06756051fc07 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:35 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4f7f18f-d6b0-476a-a32c-06756051fc07 Jun 03 12:11:35 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:35 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7afa5421-d3dc-4081-b7d3-32747551feb4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.721s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:35 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-7afa5421-d3dc-4081-b7d3-32747551feb4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:11:35 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-7afa5421-d3dc-4081-b7d3-32747551feb4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Deleted volume successfully. Jun 03 12:11:35 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d5a773fd-bc7a-4480-8aa3-dd0b475019dc Jun 03 12:11:35 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:35 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7afa5421-d3dc-4081-b7d3-32747551feb4 tempest-CreateVolumesFromSourceVolumeTest-884594533 None] Lock "cinder-87b68ef9-9fb7-410c-a878-1ba50669264a-delete_volume" released by "delete_volume" :: held 4.592s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:36 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4f7f18f-d6b0-476a-a32c-06756051fc07" returned: 0 in 0.667s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Lock "cinder-quobyte-d4f7f18f-d6b0-476a-a32c-06756051fc07" released by "_copy_volume_from_snapshot" :: held 10.848s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Lock "cinder-quobyte-73d69893-db8c-445e-b0bc-4659a8610bd3-d4f7f18f-d6b0-476a-a32c-06756051fc07" released by "_create_volume_from_snapshot" :: held 10.927s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.974s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.032s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2080302294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6952a5-ed89-402d-a55b-01a34b9c7663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb0e28f5c34431d9b3e04e5c45512cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:28Z,use_quota=True,user_id='ee5de16c5cfd49f1b90caea3d969ad9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Creating volume 1e6952a5-ed89-402d-a55b-01a34b9c7663 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:11:36 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1e6952a5-ed89-402d-a55b-01a34b9c7663 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:36 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-95b59e77-7a81-42dc-a12b-748eccaed1cf tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d5a773fd-bc7a-4480-8aa3-dd0b475019dc" returned: 0 in 0.813s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-95b59e77-7a81-42dc-a12b-748eccaed1cf tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d5a773fd-bc7a-4480-8aa3-dd0b475019dc {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:36 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1e6952a5-ed89-402d-a55b-01a34b9c7663 1073741824 Jun 03 12:11:36 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89025471-6b39-41f4-aa20-531ed3d49735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4f7f18f-d6b0-476a-a32c-06756051fc07', 'volume_size': 1, 'snapshot_id': '73d69893-db8c-445e-b0bc-4659a8610bd3'}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49065fd3-4a95-4849-8d24-e7477c4a2d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:36 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d5a773fd-bc7a-4480-8aa3-dd0b475019dc Jun 03 12:11:36 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:36 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Volume volume-d4f7f18f-d6b0-476a-a32c-06756051fc07 (d4f7f18f-d6b0-476a-a32c-06756051fc07): created successfully Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49065fd3-4a95-4849-8d24-e7477c4a2d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Flow 'volume_create_manager' (b489ce55-1a95-4265-9e0c-2a42dc191dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:36 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-3c6722ea-89c1-40ef-8f36-344b5d510c98 tempest-VolumeDependencyTests-1714046286 None] Created volume successfully. Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] Acquiring lock "cinder-73d69893-db8c-445e-b0bc-4659a8610bd3-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] Lock "cinder-73d69893-db8c-445e-b0bc-4659a8610bd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:36 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] Acquiring lock "cinder-quobyte-64fdf3a7-7bd1-4d2e-a034-fbabac56d552" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] Lock "cinder-quobyte-64fdf3a7-7bd1-4d2e-a034-fbabac56d552" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] Acquiring lock "cinder-quobyte-73d69893-db8c-445e-b0bc-4659a8610bd3" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] Lock "cinder-quobyte-73d69893-db8c-445e-b0bc-4659a8610bd3" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] Deleting offline snapshot 73d69893-db8c-445e-b0bc-4659a8610bd3 of volume 64fdf3a7-7bd1-4d2e-a034-fbabac56d552 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] snapshot_file for this snap is: volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e222d9-299c-47c1-9f51-8013c690331d]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:37 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3 Jun 03 12:11:37 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:37 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-95b59e77-7a81-42dc-a12b-748eccaed1cf tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d5a773fd-bc7a-4480-8aa3-dd0b475019dc" returned: 0 in 1.009s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-95b59e77-7a81-42dc-a12b-748eccaed1cf tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-quobyte-d5a773fd-bc7a-4480-8aa3-dd0b475019dc" released by "delete_volume" :: held 1.881s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:37 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1e6952a5-ed89-402d-a55b-01a34b9c7663 1073741824" returned: 0 in 1.113s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-95b59e77-7a81-42dc-a12b-748eccaed1cf tempest-CreateVolumesFromSnapshotTest-1693238937 None] Created reservations ['c76d5105-eefa-40fd-9cc8-7afb705d780c', '02e08143-1097-4da8-993f-29084f93eb2e', 'a4aab9e5-23b1-4646-866d-871cf80e655b', 'cda22622-ca39-4e0a-8ab4-6fd2a9114fe2'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1e6952a5-ed89-402d-a55b-01a34b9c7663 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:37 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1e6952a5-ed89-402d-a55b-01a34b9c7663 Jun 03 12:11:37 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-95b59e77-7a81-42dc-a12b-748eccaed1cf tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-95b59e77-7a81-42dc-a12b-748eccaed1cf tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-95b59e77-7a81-42dc-a12b-748eccaed1cf tempest-CreateVolumesFromSnapshotTest-1693238937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-95b59e77-7a81-42dc-a12b-748eccaed1cf tempest-CreateVolumesFromSnapshotTest-1693238937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-95b59e77-7a81-42dc-a12b-748eccaed1cf tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-95b59e77-7a81-42dc-a12b-748eccaed1cf tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:37 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:11:37 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-997fc8af-6d16-41bf-b5e4-062efc22c604 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "cinder-4526f602-0a9c-4220-85fb-c572b77c3042-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-997fc8af-6d16-41bf-b5e4-062efc22c604 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-4526f602-0a9c-4220-85fb-c572b77c3042-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:37 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3" returned: 0 in 0.923s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[744c684f-e580-433b-951e-5e496fc509f8]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-997fc8af-6d16-41bf-b5e4-062efc22c604 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "cinder-quobyte-4526f602-0a9c-4220-85fb-c572b77c3042" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-997fc8af-6d16-41bf-b5e4-062efc22c604 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-quobyte-4526f602-0a9c-4220-85fb-c572b77c3042" acquired by "delete_volume" :: waited 0.019s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a869f4-501d-4cb9-8409-84f329dca518]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-997fc8af-6d16-41bf-b5e4-062efc22c604 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4526f602-0a9c-4220-85fb-c572b77c3042 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:38 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 Jun 03 12:11:38 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:38 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1e6952a5-ed89-402d-a55b-01a34b9c7663" returned: 0 in 0.752s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.613s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1577486446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f48391f3-0b6e-4c9e-a7da-0ace036e1702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb0e28f5c34431d9b3e04e5c45512cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:29Z,use_quota=True,user_id='ee5de16c5cfd49f1b90caea3d969ad9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Creating volume f48391f3-0b6e-4c9e-a7da-0ace036e1702 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:11:38 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f48391f3-0b6e-4c9e-a7da-0ace036e1702 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:38 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f48391f3-0b6e-4c9e-a7da-0ace036e1702 1073741824 Jun 03 12:11:38 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eba592f-45a2-4be9-a5f3-8188a686dfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e6952a5-ed89-402d-a55b-01a34b9c7663', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf0565f-2de8-4b5a-9e24-ad989e8686b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:38 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Volume volume-1e6952a5-ed89-402d-a55b-01a34b9c7663 (1e6952a5-ed89-402d-a55b-01a34b9c7663): created successfully Jun 03 12:11:38 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4526f602-0a9c-4220-85fb-c572b77c3042 Jun 03 12:11:38 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf0565f-2de8-4b5a-9e24-ad989e8686b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Flow 'volume_create_manager' (49bbf2c0-6f89-4aae-9cd6-e6d8a9e448f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:38 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c38a18e9-0578-45bd-9ae1-81bd4085a176 tempest-CreateVolumesFromImageTest-1328511443 None] Created volume successfully. Jun 03 12:11:38 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-95b59e77-7a81-42dc-a12b-748eccaed1cf tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.976s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-95b59e77-7a81-42dc-a12b-748eccaed1cf tempest-CreateVolumesFromSnapshotTest-1693238937 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:11:38 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-95b59e77-7a81-42dc-a12b-748eccaed1cf tempest-CreateVolumesFromSnapshotTest-1693238937 None] Deleted volume successfully. Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-95b59e77-7a81-42dc-a12b-748eccaed1cf tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-d5a773fd-bc7a-4480-8aa3-dd0b475019dc-delete_volume" released by "delete_volume" :: held 3.193s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:38 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552" returned: 0 in 0.932s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:39 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3 Jun 03 12:11:39 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:39 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-997fc8af-6d16-41bf-b5e4-062efc22c604 tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4526f602-0a9c-4220-85fb-c572b77c3042" returned: 0 in 1.123s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-997fc8af-6d16-41bf-b5e4-062efc22c604 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4526f602-0a9c-4220-85fb-c572b77c3042 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:39 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4526f602-0a9c-4220-85fb-c572b77c3042 Jun 03 12:11:39 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:39 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f48391f3-0b6e-4c9e-a7da-0ace036e1702 1073741824" returned: 0 in 1.174s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:39 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:11:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Flow 'volume_create_manager' (e280937d-e82e-421e-b453-8cd4efd48ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d243f50-ec97-4107-84ee-96eb22673331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d243f50-ec97-4107-84ee-96eb22673331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ecaeb7-8138-4c65-bad0-619bf3e3de74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1d570c225840818aa55f5d87a14c45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:39Z,use_quota=True,user_id='6b4ee6e7293c4bf2b4a5ac2ad24d800b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1c92f1-377d-4bfa-8ca6-4876a089e237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1c92f1-377d-4bfa-8ca6-4876a089e237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ad9ff9-1810-4e63-8f0f-8cc917af63f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ad9ff9-1810-4e63-8f0f-8cc917af63f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2ecaeb7-8138-4c65-bad0-619bf3e3de74', 'volume_name': 'volume-f2ecaeb7-8138-4c65-bad0-619bf3e3de74', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7486b65b-4c6e-4f12-b287-8b2c8e6adba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7486b65b-4c6e-4f12-b287-8b2c8e6adba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:39 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400f9674-1131-4150-95dd-148790aae55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:39 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Volume f2ecaeb7-8138-4c65-bad0-619bf3e3de74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2ecaeb7-8138-4c65-bad0-619bf3e3de74', 'volume_size': 1} Jun 03 12:11:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f48391f3-0b6e-4c9e-a7da-0ace036e1702 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:39 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f48391f3-0b6e-4c9e-a7da-0ace036e1702 Jun 03 12:11:39 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:39 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3" returned: 0 in 0.912s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:39 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-997fc8af-6d16-41bf-b5e4-062efc22c604 tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-4526f602-0a9c-4220-85fb-c572b77c3042" returned: 0 in 0.656s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:39 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3 Jun 03 12:11:39 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-997fc8af-6d16-41bf-b5e4-062efc22c604 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-quobyte-4526f602-0a9c-4220-85fb-c572b77c3042" released by "delete_volume" :: held 1.835s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:39 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-997fc8af-6d16-41bf-b5e4-062efc22c604 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Created reservations ['b0f7ea7e-03d8-4a43-a6b7-8686554c1647', '71463a9d-4a14-4e1e-a5fa-6be4b2c8ef4c', 'f3bb320f-15bb-4409-8cf6-bc111a23c4d3', 'f2e0d3e9-387c-42d4-84aa-07cb151a33bb'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-997fc8af-6d16-41bf-b5e4-062efc22c604 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-997fc8af-6d16-41bf-b5e4-062efc22c604 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-997fc8af-6d16-41bf-b5e4-062efc22c604 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-997fc8af-6d16-41bf-b5e4-062efc22c604 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-997fc8af-6d16-41bf-b5e4-062efc22c604 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-997fc8af-6d16-41bf-b5e4-062efc22c604 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:40 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:11:40 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:40 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f48391f3-0b6e-4c9e-a7da-0ace036e1702" returned: 0 in 0.663s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] <== create_volume: return (1972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.651s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1574825909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb0e28f5c34431d9b3e04e5c45512cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:30Z,use_quota=True,user_id='ee5de16c5cfd49f1b90caea3d969ad9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Creating volume 20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:11:40 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-700ddd10-60d8-49f1-bf9f-7d95c260e252 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "cinder-018d9e78-3816-448a-8426-08152fe7ae04-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:40 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a 1073741824 Jun 03 12:11:40 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c7f49e-1e90-4e31-8dc4-b62c0af89c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f48391f3-0b6e-4c9e-a7da-0ace036e1702', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab72c8ce-a4c1-4ca5-b22e-3390f4b082a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-700ddd10-60d8-49f1-bf9f-7d95c260e252 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-018d9e78-3816-448a-8426-08152fe7ae04-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:40 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Volume volume-f48391f3-0b6e-4c9e-a7da-0ace036e1702 (f48391f3-0b6e-4c9e-a7da-0ace036e1702): created successfully Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab72c8ce-a4c1-4ca5-b22e-3390f4b082a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Flow 'volume_create_manager' (5636fc58-24b6-4b5f-be2d-774e53036d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:40 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-55fa4a76-1eda-4133-a128-c2d33cf5cd6f tempest-CreateVolumesFromImageTest-1328511443 None] Created volume successfully. Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-700ddd10-60d8-49f1-bf9f-7d95c260e252 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "cinder-quobyte-018d9e78-3816-448a-8426-08152fe7ae04" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-700ddd10-60d8-49f1-bf9f-7d95c260e252 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-quobyte-018d9e78-3816-448a-8426-08152fe7ae04" acquired by "delete_volume" :: waited 0.032s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb758c5-48b1-4231-b8aa-1d7cf18a7771]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-700ddd10-60d8-49f1-bf9f-7d95c260e252 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-018d9e78-3816-448a-8426-08152fe7ae04 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:40 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-018d9e78-3816-448a-8426-08152fe7ae04 Jun 03 12:11:40 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:40 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552.73d69893-db8c-445e-b0bc-4659a8610bd3" returned: 0 in 0.711s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] Lock "cinder-quobyte-73d69893-db8c-445e-b0bc-4659a8610bd3" released by "_delete_snapshot" :: held 3.627s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] Lock "cinder-quobyte-64fdf3a7-7bd1-4d2e-a034-fbabac56d552" released by "delete_snapshot" :: held 3.663s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] Created reservations ['a64f5f0b-8df2-4b6e-8c9a-0afc9ce7233d', '7f3ffcae-8547-419e-9708-4ccd82f9c4ce', '2edcd2a8-ac90-4bf2-b5a8-f48965b784ca', 'b535adb0-c904-4fa2-a831-169a63a8362a'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:40 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] Delete snapshot completed successfully. Jun 03 12:11:40 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-bbc8651d-edf9-43ba-8bd0-93c44fd7bec7 tempest-VolumeDependencyTests-1714046286 None] Lock "cinder-73d69893-db8c-445e-b0bc-4659a8610bd3-delete_snapshot" released by "delete_snapshot" :: held 3.833s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-997fc8af-6d16-41bf-b5e4-062efc22c604 tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.742s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-997fc8af-6d16-41bf-b5e4-062efc22c604 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:11:40 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-997fc8af-6d16-41bf-b5e4-062efc22c604 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Deleted volume successfully. Jun 03 12:11:40 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-997fc8af-6d16-41bf-b5e4-062efc22c604 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-4526f602-0a9c-4220-85fb-c572b77c3042-delete_volume" released by "delete_volume" :: held 2.881s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:41 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a 1073741824" returned: 0 in 0.988s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:41 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-700ddd10-60d8-49f1-bf9f-7d95c260e252 tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-018d9e78-3816-448a-8426-08152fe7ae04" returned: 0 in 0.790s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-700ddd10-60d8-49f1-bf9f-7d95c260e252 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-018d9e78-3816-448a-8426-08152fe7ae04 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:41 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-018d9e78-3816-448a-8426-08152fe7ae04 Jun 03 12:11:41 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a2f0a3d6-d3ff-4ed3-9233-675a0744fb1a tempest-VolumeDependencyTests-1714046286 None] Acquiring lock "cinder-64fdf3a7-7bd1-4d2e-a034-fbabac56d552-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:41 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a Jun 03 12:11:41 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a2f0a3d6-d3ff-4ed3-9233-675a0744fb1a tempest-VolumeDependencyTests-1714046286 None] Lock "cinder-64fdf3a7-7bd1-4d2e-a034-fbabac56d552-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a2f0a3d6-d3ff-4ed3-9233-675a0744fb1a tempest-VolumeDependencyTests-1714046286 None] Acquiring lock "cinder-quobyte-64fdf3a7-7bd1-4d2e-a034-fbabac56d552" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a2f0a3d6-d3ff-4ed3-9233-675a0744fb1a tempest-VolumeDependencyTests-1714046286 None] Lock "cinder-quobyte-64fdf3a7-7bd1-4d2e-a034-fbabac56d552" acquired by "delete_volume" :: waited 0.018s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac61b17-d866-46bd-b39e-acecb5ce67ff]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a2f0a3d6-d3ff-4ed3-9233-675a0744fb1a tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:41 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 Jun 03 12:11:41 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:41 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-700ddd10-60d8-49f1-bf9f-7d95c260e252 tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-018d9e78-3816-448a-8426-08152fe7ae04" returned: 0 in 0.662s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:41 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a" returned: 0 in 0.660s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-700ddd10-60d8-49f1-bf9f-7d95c260e252 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-quobyte-018d9e78-3816-448a-8426-08152fe7ae04" released by "delete_volume" :: held 1.520s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.684s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-23888634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19b6a69-b3bd-415b-93f0-628d44039613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb0e28f5c34431d9b3e04e5c45512cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:32Z,use_quota=True,user_id='ee5de16c5cfd49f1b90caea3d969ad9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Creating volume c19b6a69-b3bd-415b-93f0-628d44039613 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:11:41 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c19b6a69-b3bd-415b-93f0-628d44039613 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:41 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c19b6a69-b3bd-415b-93f0-628d44039613 1073741824 Jun 03 12:11:41 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0fe1a2-5bed-436b-9d19-2c97dada88e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:41 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e65b094b-621f-4600-9ca2-2edffcd41620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:42 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Volume volume-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a (20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a): created successfully Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e65b094b-621f-4600-9ca2-2edffcd41620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Flow 'volume_create_manager' (dd763145-bc1e-4b27-be8a-57639a1a6ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:42 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c969af11-ebc0-4560-8e79-a3a45132e0a9 tempest-CreateVolumesFromImageTest-1328511443 None] Created volume successfully. Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-700ddd10-60d8-49f1-bf9f-7d95c260e252 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Created reservations ['247135cc-f325-46f9-a1b1-dbd7098be54e', 'f95a03dd-de7c-4cc8-8e00-d95d0a363c3d', 'd74cd8f0-13f9-4184-9958-f4e211a2316a', 'a7eb9415-27bf-48f0-b233-a863eeddb936'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-700ddd10-60d8-49f1-bf9f-7d95c260e252 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-700ddd10-60d8-49f1-bf9f-7d95c260e252 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-700ddd10-60d8-49f1-bf9f-7d95c260e252 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-700ddd10-60d8-49f1-bf9f-7d95c260e252 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-700ddd10-60d8-49f1-bf9f-7d95c260e252 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-700ddd10-60d8-49f1-bf9f-7d95c260e252 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:42 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:11:42 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:42 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a2f0a3d6-d3ff-4ed3-9233-675a0744fb1a tempest-VolumeDependencyTests-1714046286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552" returned: 0 in 0.757s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a2f0a3d6-d3ff-4ed3-9233-675a0744fb1a tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:42 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552 Jun 03 12:11:42 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "cinder-adc8531a-35f2-455a-baf3-9bca76abe28f-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-adc8531a-35f2-455a-baf3-9bca76abe28f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "cinder-quobyte-722ddd52-ac26-4e6d-8d25-45d035a7dd2b" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-quobyte-722ddd52-ac26-4e6d-8d25-45d035a7dd2b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "cinder-quobyte-adc8531a-35f2-455a-baf3-9bca76abe28f" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-quobyte-adc8531a-35f2-455a-baf3-9bca76abe28f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Deleting offline snapshot adc8531a-35f2-455a-baf3-9bca76abe28f of volume 722ddd52-ac26-4e6d-8d25-45d035a7dd2b {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] snapshot_file for this snap is: volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.adc8531a-35f2-455a-baf3-9bca76abe28f {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[82aad441-aa79-4568-9538-232512d3e3d1]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.adc8531a-35f2-455a-baf3-9bca76abe28f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:42 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.adc8531a-35f2-455a-baf3-9bca76abe28f Jun 03 12:11:42 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:42 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-700ddd10-60d8-49f1-bf9f-7d95c260e252 tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.694s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-700ddd10-60d8-49f1-bf9f-7d95c260e252 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:11:42 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-700ddd10-60d8-49f1-bf9f-7d95c260e252 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Deleted volume successfully. Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-700ddd10-60d8-49f1-bf9f-7d95c260e252 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-018d9e78-3816-448a-8426-08152fe7ae04-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:42 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c19b6a69-b3bd-415b-93f0-628d44039613 1073741824" returned: 0 in 0.928s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:42 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c19b6a69-b3bd-415b-93f0-628d44039613 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:42 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c19b6a69-b3bd-415b-93f0-628d44039613 Jun 03 12:11:42 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:43 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a2f0a3d6-d3ff-4ed3-9233-675a0744fb1a tempest-VolumeDependencyTests-1714046286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-64fdf3a7-7bd1-4d2e-a034-fbabac56d552" returned: 0 in 0.795s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a2f0a3d6-d3ff-4ed3-9233-675a0744fb1a tempest-VolumeDependencyTests-1714046286 None] Lock "cinder-quobyte-64fdf3a7-7bd1-4d2e-a034-fbabac56d552" released by "delete_volume" :: held 1.642s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-a2f0a3d6-d3ff-4ed3-9233-675a0744fb1a tempest-VolumeDependencyTests-1714046286 None] Created reservations ['cf45bff8-4b9c-423a-8101-cfcca3b98779', '98e8416d-f0fc-42d1-a6a3-05b2fb520b2a', 'dd0bd7fb-a107-4b7d-b385-59cb94c3389f', 'f20d9ba9-3a6d-472c-9cc6-af3da6cf1dc1'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a2f0a3d6-d3ff-4ed3-9233-675a0744fb1a tempest-VolumeDependencyTests-1714046286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a2f0a3d6-d3ff-4ed3-9233-675a0744fb1a tempest-VolumeDependencyTests-1714046286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a2f0a3d6-d3ff-4ed3-9233-675a0744fb1a tempest-VolumeDependencyTests-1714046286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-a2f0a3d6-d3ff-4ed3-9233-675a0744fb1a tempest-VolumeDependencyTests-1714046286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-a2f0a3d6-d3ff-4ed3-9233-675a0744fb1a tempest-VolumeDependencyTests-1714046286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a2f0a3d6-d3ff-4ed3-9233-675a0744fb1a tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:43 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:11:43 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:43 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.adc8531a-35f2-455a-baf3-9bca76abe28f" returned: 0 in 0.786s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38292dd-293f-4322-88af-acecdde6f628]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:43 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b Jun 03 12:11:43 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e5bdee0f-dd00-4e66-852a-47f85282c4fa tempest-VolumeDependencyTests-1714046286 None] Acquiring lock "cinder-d4f7f18f-d6b0-476a-a32c-06756051fc07-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:43 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c19b6a69-b3bd-415b-93f0-628d44039613" returned: 0 in 0.705s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e5bdee0f-dd00-4e66-852a-47f85282c4fa tempest-VolumeDependencyTests-1714046286 None] Lock "cinder-d4f7f18f-d6b0-476a-a32c-06756051fc07-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-800176927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b98abed-184f-464d-8add-8f1f1fb07886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb0e28f5c34431d9b3e04e5c45512cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:33Z,use_quota=True,user_id='ee5de16c5cfd49f1b90caea3d969ad9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Creating volume 2b98abed-184f-464d-8add-8f1f1fb07886 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:11:43 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2b98abed-184f-464d-8add-8f1f1fb07886 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241fd0ff-0c5a-4499-afc7-1841119635f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c19b6a69-b3bd-415b-93f0-628d44039613', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3317f1-304f-4ba5-8975-d761e6a0d765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:43 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2b98abed-184f-464d-8add-8f1f1fb07886 1073741824 Jun 03 12:11:43 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:43 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Volume volume-c19b6a69-b3bd-415b-93f0-628d44039613 (c19b6a69-b3bd-415b-93f0-628d44039613): created successfully Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3317f1-304f-4ba5-8975-d761e6a0d765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Flow 'volume_create_manager' (52371453-ed27-4f24-92ac-466c029c217d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e5bdee0f-dd00-4e66-852a-47f85282c4fa tempest-VolumeDependencyTests-1714046286 None] Acquiring lock "cinder-quobyte-d4f7f18f-d6b0-476a-a32c-06756051fc07" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:43 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-2fc96150-97f8-46d3-bfc0-f87d36149f90 tempest-CreateVolumesFromImageTest-1328511443 None] Created volume successfully. Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e5bdee0f-dd00-4e66-852a-47f85282c4fa tempest-VolumeDependencyTests-1714046286 None] Lock "cinder-quobyte-d4f7f18f-d6b0-476a-a32c-06756051fc07" acquired by "delete_volume" :: waited 0.030s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[610650c7-0599-4dc6-a2da-4325bc9bccef]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e5bdee0f-dd00-4e66-852a-47f85282c4fa tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4f7f18f-d6b0-476a-a32c-06756051fc07 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:43 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a2f0a3d6-d3ff-4ed3-9233-675a0744fb1a tempest-VolumeDependencyTests-1714046286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.735s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-a2f0a3d6-d3ff-4ed3-9233-675a0744fb1a tempest-VolumeDependencyTests-1714046286 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:11:43 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a2f0a3d6-d3ff-4ed3-9233-675a0744fb1a tempest-VolumeDependencyTests-1714046286 None] Deleted volume successfully. Jun 03 12:11:43 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a2f0a3d6-d3ff-4ed3-9233-675a0744fb1a tempest-VolumeDependencyTests-1714046286 None] Lock "cinder-64fdf3a7-7bd1-4d2e-a034-fbabac56d552-delete_volume" released by "delete_volume" :: held 2.605s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:43 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4f7f18f-d6b0-476a-a32c-06756051fc07 Jun 03 12:11:43 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:44 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b" returned: 0 in 0.992s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.adc8531a-35f2-455a-baf3-9bca76abe28f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:44 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.adc8531a-35f2-455a-baf3-9bca76abe28f Jun 03 12:11:44 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:44 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e5bdee0f-dd00-4e66-852a-47f85282c4fa tempest-VolumeDependencyTests-1714046286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4f7f18f-d6b0-476a-a32c-06756051fc07" returned: 0 in 0.849s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e5bdee0f-dd00-4e66-852a-47f85282c4fa tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4f7f18f-d6b0-476a-a32c-06756051fc07 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:44 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2b98abed-184f-464d-8add-8f1f1fb07886 1073741824" returned: 0 in 1.036s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:44 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4f7f18f-d6b0-476a-a32c-06756051fc07 Jun 03 12:11:44 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:44 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2b98abed-184f-464d-8add-8f1f1fb07886 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:44 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2b98abed-184f-464d-8add-8f1f1fb07886 Jun 03 12:11:44 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:45 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.adc8531a-35f2-455a-baf3-9bca76abe28f" returned: 0 in 0.780s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.adc8531a-35f2-455a-baf3-9bca76abe28f {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:45 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.adc8531a-35f2-455a-baf3-9bca76abe28f Jun 03 12:11:45 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:45 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e5bdee0f-dd00-4e66-852a-47f85282c4fa tempest-VolumeDependencyTests-1714046286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-d4f7f18f-d6b0-476a-a32c-06756051fc07" returned: 0 in 0.662s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:45 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e5bdee0f-dd00-4e66-852a-47f85282c4fa tempest-VolumeDependencyTests-1714046286 None] Lock "cinder-quobyte-d4f7f18f-d6b0-476a-a32c-06756051fc07" released by "delete_volume" :: held 1.579s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2b98abed-184f-464d-8add-8f1f1fb07886" returned: 0 in 0.637s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.826s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ecaeb7-8138-4c65-bad0-619bf3e3de74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1d570c225840818aa55f5d87a14c45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:39Z,use_quota=True,user_id='6b4ee6e7293c4bf2b4a5ac2ad24d800b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Creating volume f2ecaeb7-8138-4c65-bad0-619bf3e3de74 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:11:45 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f2ecaeb7-8138-4c65-bad0-619bf3e3de74 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:45 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f2ecaeb7-8138-4c65-bad0-619bf3e3de74 1073741824 Jun 03 12:11:45 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be93b83d-3f08-4903-8a22-62945dbd288a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b98abed-184f-464d-8add-8f1f1fb07886', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa5670e-18d0-40a0-9157-aeb4aa2dad82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:45 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Volume volume-2b98abed-184f-464d-8add-8f1f1fb07886 (2b98abed-184f-464d-8add-8f1f1fb07886): created successfully Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa5670e-18d0-40a0-9157-aeb4aa2dad82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Flow 'volume_create_manager' (f1b57ffd-e933-44f3-8a7b-d055e77c2783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:45 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-0703bfc3-ef43-4f76-9a60-731888d4554a tempest-CreateVolumesFromImageTest-1328511443 None] Created volume successfully. Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-e5bdee0f-dd00-4e66-852a-47f85282c4fa tempest-VolumeDependencyTests-1714046286 None] Created reservations ['e77e35f5-7ffa-48d4-bd9a-041ef94d5be0', '6743f9f9-3f6a-45a7-9263-607283c7d309', '8dda800b-95cd-497d-8852-400f76b54f52', '7a0d12ba-6da5-4bc8-95d3-5dccebf52a4e'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e5bdee0f-dd00-4e66-852a-47f85282c4fa tempest-VolumeDependencyTests-1714046286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e5bdee0f-dd00-4e66-852a-47f85282c4fa tempest-VolumeDependencyTests-1714046286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e5bdee0f-dd00-4e66-852a-47f85282c4fa tempest-VolumeDependencyTests-1714046286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e5bdee0f-dd00-4e66-852a-47f85282c4fa tempest-VolumeDependencyTests-1714046286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e5bdee0f-dd00-4e66-852a-47f85282c4fa tempest-VolumeDependencyTests-1714046286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e5bdee0f-dd00-4e66-852a-47f85282c4fa tempest-VolumeDependencyTests-1714046286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:45 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:11:45 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4755683b-e3de-4d3d-8367-04167038dce9 tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "cinder-2b98abed-184f-464d-8add-8f1f1fb07886-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4755683b-e3de-4d3d-8367-04167038dce9 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "cinder-2b98abed-184f-464d-8add-8f1f1fb07886-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4755683b-e3de-4d3d-8367-04167038dce9 tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "cinder-quobyte-2b98abed-184f-464d-8add-8f1f1fb07886" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:45 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4755683b-e3de-4d3d-8367-04167038dce9 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "cinder-quobyte-2b98abed-184f-464d-8add-8f1f1fb07886" acquired by "delete_volume" :: waited 0.031s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:46 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6870371d-d4c1-4e08-890b-d3ddf4c81569]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4755683b-e3de-4d3d-8367-04167038dce9 tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2b98abed-184f-464d-8add-8f1f1fb07886 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:46 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b.adc8531a-35f2-455a-baf3-9bca76abe28f" returned: 0 in 0.820s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:46 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-quobyte-adc8531a-35f2-455a-baf3-9bca76abe28f" released by "_delete_snapshot" :: held 3.536s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:46 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-quobyte-722ddd52-ac26-4e6d-8d25-45d035a7dd2b" released by "delete_snapshot" :: held 3.570s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:46 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Created reservations ['fd14109e-d30e-4d56-a055-6562de3b58b2', '1fb65d07-6e60-4a97-9018-33530defee90', '3951c963-a677-4819-b3f3-a22b83aa9db7', 'b1fb5a60-ff07-4a4b-ba00-1810cce384d1'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:46 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2b98abed-184f-464d-8add-8f1f1fb07886 Jun 03 12:11:46 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:46 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Delete snapshot completed successfully. Jun 03 12:11:46 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-5db18797-4204-43d5-b5c9-4e72dcb72871 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-adc8531a-35f2-455a-baf3-9bca76abe28f-delete_snapshot" released by "delete_snapshot" :: held 3.785s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:46 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e5bdee0f-dd00-4e66-852a-47f85282c4fa tempest-VolumeDependencyTests-1714046286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.883s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:46 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-e5bdee0f-dd00-4e66-852a-47f85282c4fa tempest-VolumeDependencyTests-1714046286 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:11:46 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-e5bdee0f-dd00-4e66-852a-47f85282c4fa tempest-VolumeDependencyTests-1714046286 None] Deleted volume successfully. Jun 03 12:11:46 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=126,cinder:UPDATE=193,cinder:INSERT=37,cinder:DELETE=18 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:11:46 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e5bdee0f-dd00-4e66-852a-47f85282c4fa tempest-VolumeDependencyTests-1714046286 None] Lock "cinder-d4f7f18f-d6b0-476a-a32c-06756051fc07-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:46 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f2ecaeb7-8138-4c65-bad0-619bf3e3de74 1073741824" returned: 0 in 1.144s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:46 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f2ecaeb7-8138-4c65-bad0-619bf3e3de74 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:46 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f2ecaeb7-8138-4c65-bad0-619bf3e3de74 Jun 03 12:11:46 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:46 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e7af16ef-def6-424f-840f-416cad7bae31 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "cinder-722ddd52-ac26-4e6d-8d25-45d035a7dd2b-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:46 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e7af16ef-def6-424f-840f-416cad7bae31 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-722ddd52-ac26-4e6d-8d25-45d035a7dd2b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:46 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e7af16ef-def6-424f-840f-416cad7bae31 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "cinder-quobyte-722ddd52-ac26-4e6d-8d25-45d035a7dd2b" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:46 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e7af16ef-def6-424f-840f-416cad7bae31 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-quobyte-722ddd52-ac26-4e6d-8d25-45d035a7dd2b" acquired by "delete_volume" :: waited 0.027s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:47 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[274908e6-2d5c-4437-98fe-7bcd50659f1e]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e7af16ef-def6-424f-840f-416cad7bae31 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:47 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4755683b-e3de-4d3d-8367-04167038dce9 tempest-CreateVolumesFromImageTest-1328511443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2b98abed-184f-464d-8add-8f1f1fb07886" returned: 0 in 1.130s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4755683b-e3de-4d3d-8367-04167038dce9 tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2b98abed-184f-464d-8add-8f1f1fb07886 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:47 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2b98abed-184f-464d-8add-8f1f1fb07886 Jun 03 12:11:47 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:47 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b Jun 03 12:11:47 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:47 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f2ecaeb7-8138-4c65-bad0-619bf3e3de74" returned: 0 in 0.843s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:47 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] <== create_volume: return (2038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:11:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400f9674-1131-4150-95dd-148790aae55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2ecaeb7-8138-4c65-bad0-619bf3e3de74', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be96b43f-219e-4b2a-a9cd-fb26e66a2297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:47 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=151,cinder:INSERT=58,cinder:UPDATE=185,cinder:DELETE=18 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:11:47 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Volume volume-f2ecaeb7-8138-4c65-bad0-619bf3e3de74 (f2ecaeb7-8138-4c65-bad0-619bf3e3de74): created successfully Jun 03 12:11:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be96b43f-219e-4b2a-a9cd-fb26e66a2297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:47 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Flow 'volume_create_manager' (e280937d-e82e-421e-b453-8cd4efd48ff4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:47 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-e6ed8e06-9b00-4e8e-8280-ffbc1ac9ea21 tempest-CinderUnicodeTest-507854956 None] Created volume successfully. Jun 03 12:11:47 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4755683b-e3de-4d3d-8367-04167038dce9 tempest-CreateVolumesFromImageTest-1328511443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-2b98abed-184f-464d-8add-8f1f1fb07886" returned: 0 in 0.733s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:47 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4755683b-e3de-4d3d-8367-04167038dce9 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "cinder-quobyte-2b98abed-184f-464d-8add-8f1f1fb07886" released by "delete_volume" :: held 1.942s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:47 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-4755683b-e3de-4d3d-8367-04167038dce9 tempest-CreateVolumesFromImageTest-1328511443 None] Created reservations ['4d604b07-498b-4c17-92cd-64373e0e56b9', '1e46b367-20ad-4809-9b28-29e363e0e750', '2729ddd0-ffcf-4deb-81b3-7f9f360a1917', '3701e0c6-ba57-498e-b411-ca04a804ae52'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:47 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e7af16ef-def6-424f-840f-416cad7bae31 tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b" returned: 0 in 0.888s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:47 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e7af16ef-def6-424f-840f-416cad7bae31 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:47 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b Jun 03 12:11:47 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4755683b-e3de-4d3d-8367-04167038dce9 tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4755683b-e3de-4d3d-8367-04167038dce9 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:48 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4755683b-e3de-4d3d-8367-04167038dce9 tempest-CreateVolumesFromImageTest-1328511443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:48 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-4755683b-e3de-4d3d-8367-04167038dce9 tempest-CreateVolumesFromImageTest-1328511443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-4755683b-e3de-4d3d-8367-04167038dce9 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4755683b-e3de-4d3d-8367-04167038dce9 tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:48 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:11:48 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-85f423b4-b1c4-48ba-8bbd-973e275a3266 tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "cinder-c19b6a69-b3bd-415b-93f0-628d44039613-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-85f423b4-b1c4-48ba-8bbd-973e275a3266 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "cinder-c19b6a69-b3bd-415b-93f0-628d44039613-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-85f423b4-b1c4-48ba-8bbd-973e275a3266 tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "cinder-quobyte-c19b6a69-b3bd-415b-93f0-628d44039613" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-85f423b4-b1c4-48ba-8bbd-973e275a3266 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "cinder-quobyte-c19b6a69-b3bd-415b-93f0-628d44039613" acquired by "delete_volume" :: waited 0.016s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:48 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[295077d7-b111-46f2-8cb9-00041bffbcdb]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-85f423b4-b1c4-48ba-8bbd-973e275a3266 tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c19b6a69-b3bd-415b-93f0-628d44039613 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:48 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c19b6a69-b3bd-415b-93f0-628d44039613 Jun 03 12:11:48 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:48 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:48 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e7af16ef-def6-424f-840f-416cad7bae31 tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-722ddd52-ac26-4e6d-8d25-45d035a7dd2b" returned: 0 in 0.809s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:48 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e7af16ef-def6-424f-840f-416cad7bae31 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-quobyte-722ddd52-ac26-4e6d-8d25-45d035a7dd2b" released by "delete_volume" :: held 1.835s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:48 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-e7af16ef-def6-424f-840f-416cad7bae31 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Created reservations ['a0814178-d12c-4275-bd0d-6011f561fea2', '287ba2ab-b350-4e6c-9066-7f0e7c3ef89e', 'cbca77ab-3187-4445-9b5d-e26cc0cb86f2', 'f5bd84aa-f280-42fd-942c-3ab4f7e16ce9'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e7af16ef-def6-424f-840f-416cad7bae31 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e7af16ef-def6-424f-840f-416cad7bae31 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e7af16ef-def6-424f-840f-416cad7bae31 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:49 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e7af16ef-def6-424f-840f-416cad7bae31 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e7af16ef-def6-424f-840f-416cad7bae31 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e7af16ef-def6-424f-840f-416cad7bae31 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:11:49 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:11:49 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Flow 'volume_create_manager' (a1796f42-448a-428b-80ee-b6c8bfd4ce9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3bf0ee7-1c27-4064-935c-c5d1c936e2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-4755683b-e3de-4d3d-8367-04167038dce9 tempest-CreateVolumesFromImageTest-1328511443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.158s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-4755683b-e3de-4d3d-8367-04167038dce9 tempest-CreateVolumesFromImageTest-1328511443 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:11:49 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-4755683b-e3de-4d3d-8367-04167038dce9 tempest-CreateVolumesFromImageTest-1328511443 None] Deleted volume successfully. Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3bf0ee7-1c27-4064-935c-c5d1c936e2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-650557523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88b733a0-62d9-4304-8b36-fb4bd544a277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1d570c225840818aa55f5d87a14c45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:49Z,use_quota=True,user_id='6b4ee6e7293c4bf2b4a5ac2ad24d800b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484c1818-c404-4352-8aed-addde9dc8c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484c1818-c404-4352-8aed-addde9dc8c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb9c5b68-6055-44c9-b040-0285ffbdea89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb9c5b68-6055-44c9-b040-0285ffbdea89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88b733a0-62d9-4304-8b36-fb4bd544a277', 'volume_name': 'volume-88b733a0-62d9-4304-8b36-fb4bd544a277', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16e77fd-72c9-4c07-b1b2-13bae2a7bbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16e77fd-72c9-4c07-b1b2-13bae2a7bbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3acfcd4f-b7d6-42f4-a04d-045abcbed7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:49 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Volume 88b733a0-62d9-4304-8b36-fb4bd544a277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88b733a0-62d9-4304-8b36-fb4bd544a277', 'volume_size': 1} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-650557523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88b733a0-62d9-4304-8b36-fb4bd544a277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1d570c225840818aa55f5d87a14c45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:49Z,use_quota=True,user_id='6b4ee6e7293c4bf2b4a5ac2ad24d800b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Creating volume 88b733a0-62d9-4304-8b36-fb4bd544a277 {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:11:49 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:49 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-85f423b4-b1c4-48ba-8bbd-973e275a3266 tempest-CreateVolumesFromImageTest-1328511443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c19b6a69-b3bd-415b-93f0-628d44039613" returned: 0 in 1.012s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-85f423b4-b1c4-48ba-8bbd-973e275a3266 tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c19b6a69-b3bd-415b-93f0-628d44039613 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:49 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277 1073741824 Jun 03 12:11:49 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:49 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-4755683b-e3de-4d3d-8367-04167038dce9 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "cinder-2b98abed-184f-464d-8add-8f1f1fb07886-delete_volume" released by "delete_volume" :: held 3.572s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:49 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c19b6a69-b3bd-415b-93f0-628d44039613 Jun 03 12:11:49 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:50 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e7af16ef-def6-424f-840f-416cad7bae31 tempest-CreateVolumesFromSnapshotTest-1693238937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.947s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:50 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-e7af16ef-def6-424f-840f-416cad7bae31 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:11:50 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-e7af16ef-def6-424f-840f-416cad7bae31 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Deleted volume successfully. Jun 03 12:11:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e7af16ef-def6-424f-840f-416cad7bae31 tempest-CreateVolumesFromSnapshotTest-1693238937 None] Lock "cinder-722ddd52-ac26-4e6d-8d25-45d035a7dd2b-delete_volume" released by "delete_volume" :: held 3.210s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:50 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-85f423b4-b1c4-48ba-8bbd-973e275a3266 tempest-CreateVolumesFromImageTest-1328511443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-c19b6a69-b3bd-415b-93f0-628d44039613" returned: 0 in 0.830s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-85f423b4-b1c4-48ba-8bbd-973e275a3266 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "cinder-quobyte-c19b6a69-b3bd-415b-93f0-628d44039613" released by "delete_volume" :: held 1.920s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:50 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-85f423b4-b1c4-48ba-8bbd-973e275a3266 tempest-CreateVolumesFromImageTest-1328511443 None] Created reservations ['bdd51c56-6a01-4f01-913e-357af4fa293d', '7a6ac860-b982-4b4b-9b88-61952b0104a2', '6b2556c3-7aef-4214-af49-a8ed0eea43aa', '0d1dfb3e-cab5-4432-851c-2999d83b9236'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-85f423b4-b1c4-48ba-8bbd-973e275a3266 tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-85f423b4-b1c4-48ba-8bbd-973e275a3266 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:50 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-85f423b4-b1c4-48ba-8bbd-973e275a3266 tempest-CreateVolumesFromImageTest-1328511443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:50 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-85f423b4-b1c4-48ba-8bbd-973e275a3266 tempest-CreateVolumesFromImageTest-1328511443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-85f423b4-b1c4-48ba-8bbd-973e275a3266 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-85f423b4-b1c4-48ba-8bbd-973e275a3266 tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:50 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:11:50 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:50 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277 1073741824" returned: 0 in 1.229s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:50 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277 Jun 03 12:11:50 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d450c9f3-7d3e-4564-80a4-2859d92d32f8 tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "cinder-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d450c9f3-7d3e-4564-80a4-2859d92d32f8 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "cinder-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d450c9f3-7d3e-4564-80a4-2859d92d32f8 tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "cinder-quobyte-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:50 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d450c9f3-7d3e-4564-80a4-2859d92d32f8 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "cinder-quobyte-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a" acquired by "delete_volume" :: waited 0.029s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:50 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae592712-1f75-41cc-8c7a-704b880cda1e]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:50 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d450c9f3-7d3e-4564-80a4-2859d92d32f8 tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:51 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a Jun 03 12:11:51 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:51 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-85f423b4-b1c4-48ba-8bbd-973e275a3266 tempest-CreateVolumesFromImageTest-1328511443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 1.065s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:51 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-85f423b4-b1c4-48ba-8bbd-973e275a3266 tempest-CreateVolumesFromImageTest-1328511443 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:11:51 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-85f423b4-b1c4-48ba-8bbd-973e275a3266 tempest-CreateVolumesFromImageTest-1328511443 None] Deleted volume successfully. Jun 03 12:11:51 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-85f423b4-b1c4-48ba-8bbd-973e275a3266 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "cinder-c19b6a69-b3bd-415b-93f0-628d44039613-delete_volume" released by "delete_volume" :: held 3.283s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:51 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277" returned: 0 in 0.925s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:51 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:11:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.219s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3acfcd4f-b7d6-42f4-a04d-045abcbed7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88b733a0-62d9-4304-8b36-fb4bd544a277', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f61b281-f613-4194-bfdc-613577459340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:51 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Volume volume-88b733a0-62d9-4304-8b36-fb4bd544a277 (88b733a0-62d9-4304-8b36-fb4bd544a277): created successfully Jun 03 12:11:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f61b281-f613-4194-bfdc-613577459340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:51 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Flow 'volume_create_manager' (a1796f42-448a-428b-80ee-b6c8bfd4ce9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:51 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-fb0c4e26-766c-45df-a615-3b1519e1bb73 tempest-CinderUnicodeTest-507854956 None] Created volume successfully. Jun 03 12:11:51 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d450c9f3-7d3e-4564-80a4-2859d92d32f8 tempest-CreateVolumesFromImageTest-1328511443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a" returned: 0 in 0.970s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:51 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d450c9f3-7d3e-4564-80a4-2859d92d32f8 tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:51 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a Jun 03 12:11:51 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-913890b5-2b4d-4a64-ace3-ad1d8031616d tempest-CinderUnicodeTest-507854956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-913890b5-2b4d-4a64-ace3-ad1d8031616d tempest-CinderUnicodeTest-507854956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:52 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-913890b5-2b4d-4a64-ace3-ad1d8031616d tempest-CinderUnicodeTest-507854956 None] Creating offline snapshot 911ef563-a562-4322-8893-762ca9fc9888 of volume 88b733a0-62d9-4304-8b36-fb4bd544a277 {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 12:11:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d450c9f3-7d3e-4564-80a4-2859d92d32f8 tempest-CreateVolumesFromImageTest-1328511443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a" returned: 0 in 0.838s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:52 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0490b4ca-0229-438b-aa03-3da9eff21351]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-913890b5-2b4d-4a64-ace3-ad1d8031616d tempest-CinderUnicodeTest-507854956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:52 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d450c9f3-7d3e-4564-80a4-2859d92d32f8 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "cinder-quobyte-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a" released by "delete_volume" :: held 1.894s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:52 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-d450c9f3-7d3e-4564-80a4-2859d92d32f8 tempest-CreateVolumesFromImageTest-1328511443 None] Created reservations ['45e8f59f-c95b-4514-9889-407f8ae10dbf', '289bb665-6a6a-4ac4-8a7d-1cb15d55cfe8', '3a86e36d-ba30-40a7-b11f-397ab000c8e2', '3c99fab9-75c6-41bc-bb31-55e2618ab27c'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d450c9f3-7d3e-4564-80a4-2859d92d32f8 tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d450c9f3-7d3e-4564-80a4-2859d92d32f8 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d450c9f3-7d3e-4564-80a4-2859d92d32f8 tempest-CreateVolumesFromImageTest-1328511443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:52 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-d450c9f3-7d3e-4564-80a4-2859d92d32f8 tempest-CreateVolumesFromImageTest-1328511443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-d450c9f3-7d3e-4564-80a4-2859d92d32f8 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:52 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d450c9f3-7d3e-4564-80a4-2859d92d32f8 tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:52 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277 Jun 03 12:11:52 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:52 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:11:52 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:53 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-212abf71-b1f9-4bad-a044-eb381bb82d01 tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "cinder-f48391f3-0b6e-4c9e-a7da-0ace036e1702-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:53 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-212abf71-b1f9-4bad-a044-eb381bb82d01 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "cinder-f48391f3-0b6e-4c9e-a7da-0ace036e1702-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:53 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-212abf71-b1f9-4bad-a044-eb381bb82d01 tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "cinder-quobyte-f48391f3-0b6e-4c9e-a7da-0ace036e1702" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:53 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-212abf71-b1f9-4bad-a044-eb381bb82d01 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "cinder-quobyte-f48391f3-0b6e-4c9e-a7da-0ace036e1702" acquired by "delete_volume" :: waited 0.018s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:53 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[09392683-4c62-4e13-bd8b-d9d7fc84377b]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-212abf71-b1f9-4bad-a044-eb381bb82d01 tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f48391f3-0b6e-4c9e-a7da-0ace036e1702 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:53 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f48391f3-0b6e-4c9e-a7da-0ace036e1702 Jun 03 12:11:53 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:53 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-d450c9f3-7d3e-4564-80a4-2859d92d32f8 tempest-CreateVolumesFromImageTest-1328511443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.944s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:53 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-d450c9f3-7d3e-4564-80a4-2859d92d32f8 tempest-CreateVolumesFromImageTest-1328511443 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:11:53 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-d450c9f3-7d3e-4564-80a4-2859d92d32f8 tempest-CreateVolumesFromImageTest-1328511443 None] Deleted volume successfully. Jun 03 12:11:53 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-913890b5-2b4d-4a64-ace3-ad1d8031616d tempest-CinderUnicodeTest-507854956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277" returned: 0 in 1.129s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:53 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-913890b5-2b4d-4a64-ace3-ad1d8031616d tempest-CinderUnicodeTest-507854956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.911ef563-a562-4322-8893-762ca9fc9888 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:53 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-d450c9f3-7d3e-4564-80a4-2859d92d32f8 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "cinder-20d2d91f-faf0-47dc-b2ea-05a7dbb95b8a-delete_volume" released by "delete_volume" :: held 3.136s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:53 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.911ef563-a562-4322-8893-762ca9fc9888 1G Jun 03 12:11:53 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:54 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:11:54 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Flow 'volume_create_manager' (46d272f6-edd8-4d55-82ef-44ddc20e5bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:11:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5b5b5a-9747-4fce-9108-ca65d8523360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-212abf71-b1f9-4bad-a044-eb381bb82d01 tempest-CreateVolumesFromImageTest-1328511443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f48391f3-0b6e-4c9e-a7da-0ace036e1702" returned: 0 in 1.113s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-212abf71-b1f9-4bad-a044-eb381bb82d01 tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f48391f3-0b6e-4c9e-a7da-0ace036e1702 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:54 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f48391f3-0b6e-4c9e-a7da-0ace036e1702 Jun 03 12:11:54 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5b5b5a-9747-4fce-9108-ca65d8523360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7caccf5-29ce-4609-a210-429092789bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c0f83cfd22c46cfb353592d2be19262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:54Z,use_quota=True,user_id='8a6242094a9644c4911aa514ea05eb3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa766159-cc48-4ce0-95b6-8bb6c7698164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa766159-cc48-4ce0-95b6-8bb6c7698164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbdba9ba-6fb0-49b4-92db-a535eee36cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:54 devstack cinder-volume[86724]: DEBUG cinder.image.glance [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Creating Keystone auth plugin from conf {{(pid=86724) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 03 12:11:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbdba9ba-6fb0-49b4-92db-a535eee36cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b7caccf5-29ce-4609-a210-429092789bdd', 'volume_name': 'volume-b7caccf5-29ce-4609-a210-429092789bdd', 'volume_size': 1, 'image_id': '310bad33-e5e4-47b6-94e2-bb659542fc09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/310bad33-e5e4-47b6-94e2-bb659542fc09', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f5bdec1f496934d3ff8b8cb9fa165358', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9c0f83cfd22c46cfb353592d2be19262', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bf39c3ffac245ae1bb81383652542ba912af3d35a3935b06aa606fa2bd2d90e9fcac01981c012cdd7e6f9b8295aa6417b02aa8352d9d467464674ac8744e2d67', 'id': '310bad33-e5e4-47b6-94e2-bb659542fc09', 'created_at': datetime.datetime(2026, 6, 3, 10, 11, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 10, 11, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/310bad33-e5e4-47b6-94e2-bb659542fc09/file', 'properties': {}}, 'image_service': }' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53254c7a-9bcb-4b59-8a26-1d987c484e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53254c7a-9bcb-4b59-8a26-1d987c484e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:11:54 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc72cea9-8d24-484d-9911-d5309c416742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:11:54 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Volume b7caccf5-29ce-4609-a210-429092789bdd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b7caccf5-29ce-4609-a210-429092789bdd', 'volume_size': 1, 'image_id': '310bad33-e5e4-47b6-94e2-bb659542fc09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/310bad33-e5e4-47b6-94e2-bb659542fc09', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f5bdec1f496934d3ff8b8cb9fa165358', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9c0f83cfd22c46cfb353592d2be19262', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bf39c3ffac245ae1bb81383652542ba912af3d35a3935b06aa606fa2bd2d90e9fcac01981c012cdd7e6f9b8295aa6417b02aa8352d9d467464674ac8744e2d67', 'id': '310bad33-e5e4-47b6-94e2-bb659542fc09', 'created_at': datetime.datetime(2026, 6, 3, 10, 11, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 10, 11, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/310bad33-e5e4-47b6-94e2-bb659542fc09/file', 'properties': {}}, 'image_service': } Jun 03 12:11:54 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Trying to clone b7caccf5-29ce-4609-a210-429092789bdd from image 310bad33-e5e4-47b6-94e2-bb659542fc09 at location (None, [{'url': 'file:///opt/stack/data/glance/images/310bad33-e5e4-47b6-94e2-bb659542fc09', 'metadata': {}}]). {{(pid=86724) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 03 12:11:54 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 03 12:11:54 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Image download 0.00 MB at 0.00 MB/s Jun 03 12:11:54 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f5357c-33ca-4e20-ac10-d5f4d12fdc58]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:54 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-913890b5-2b4d-4a64-ace3-ad1d8031616d tempest-CinderUnicodeTest-507854956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.911ef563-a562-4322-8893-762ca9fc9888 1G" returned: 0 in 1.137s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:54 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-913890b5-2b4d-4a64-ace3-ad1d8031616d tempest-CinderUnicodeTest-507854956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88b733a0-62d9-4304-8b36-fb4bd544a277 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.911ef563-a562-4322-8893-762ca9fc9888 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:54 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88b733a0-62d9-4304-8b36-fb4bd544a277 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.911ef563-a562-4322-8893-762ca9fc9888 Jun 03 12:11:54 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:55 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD Jun 03 12:11:55 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:55 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-212abf71-b1f9-4bad-a044-eb381bb82d01 tempest-CreateVolumesFromImageTest-1328511443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f48391f3-0b6e-4c9e-a7da-0ace036e1702" returned: 0 in 0.740s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:55 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-212abf71-b1f9-4bad-a044-eb381bb82d01 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "cinder-quobyte-f48391f3-0b6e-4c9e-a7da-0ace036e1702" released by "delete_volume" :: held 1.921s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:55 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-212abf71-b1f9-4bad-a044-eb381bb82d01 tempest-CreateVolumesFromImageTest-1328511443 None] Created reservations ['efb55bb6-7823-4287-9682-083c9257af45', 'f1af5e70-beba-4a65-91c1-a9f2b949de44', 'b9dafe0a-5e3e-498d-bce2-c86db99a26bc', '2b16c48c-fb4e-46da-a0fe-cb7293ee806c'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-212abf71-b1f9-4bad-a044-eb381bb82d01 tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-212abf71-b1f9-4bad-a044-eb381bb82d01 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:55 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-212abf71-b1f9-4bad-a044-eb381bb82d01 tempest-CreateVolumesFromImageTest-1328511443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:55 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-212abf71-b1f9-4bad-a044-eb381bb82d01 tempest-CreateVolumesFromImageTest-1328511443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-212abf71-b1f9-4bad-a044-eb381bb82d01 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-212abf71-b1f9-4bad-a044-eb381bb82d01 tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:55 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:11:55 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:55 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c81a595b-3231-4b50-bcc1-72061ffc0a2d tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "cinder-1e6952a5-ed89-402d-a55b-01a34b9c7663-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:55 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c81a595b-3231-4b50-bcc1-72061ffc0a2d tempest-CreateVolumesFromImageTest-1328511443 None] Lock "cinder-1e6952a5-ed89-402d-a55b-01a34b9c7663-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:55 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c81a595b-3231-4b50-bcc1-72061ffc0a2d tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "cinder-quobyte-1e6952a5-ed89-402d-a55b-01a34b9c7663" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:55 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c81a595b-3231-4b50-bcc1-72061ffc0a2d tempest-CreateVolumesFromImageTest-1328511443 None] Lock "cinder-quobyte-1e6952a5-ed89-402d-a55b-01a34b9c7663" acquired by "delete_volume" :: waited 0.020s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:55 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cafa72-ccae-4248-9e83-49357c7cf65c]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c81a595b-3231-4b50-bcc1-72061ffc0a2d tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1e6952a5-ed89-402d-a55b-01a34b9c7663 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:55 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1e6952a5-ed89-402d-a55b-01a34b9c7663 Jun 03 12:11:55 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:55 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD" returned: 0 in 0.965s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:55 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-913890b5-2b4d-4a64-ace3-ad1d8031616d tempest-CinderUnicodeTest-507854956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88b733a0-62d9-4304-8b36-fb4bd544a277 -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.911ef563-a562-4322-8893-762ca9fc9888" returned: 0 in 0.967s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:55 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-913890b5-2b4d-4a64-ace3-ad1d8031616d tempest-CinderUnicodeTest-507854956 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.911ef563-a562-4322-8893-762ca9fc9888 is being set with open permissions: ugo+rw Jun 03 12:11:55 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-913890b5-2b4d-4a64-ace3-ad1d8031616d tempest-CinderUnicodeTest-507854956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.911ef563-a562-4322-8893-762ca9fc9888 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:55 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.911ef563-a562-4322-8893-762ca9fc9888 Jun 03 12:11:55 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:56 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD Jun 03 12:11:56 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:56 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-212abf71-b1f9-4bad-a044-eb381bb82d01 tempest-CreateVolumesFromImageTest-1328511443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.843s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:56 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-212abf71-b1f9-4bad-a044-eb381bb82d01 tempest-CreateVolumesFromImageTest-1328511443 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:11:56 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-212abf71-b1f9-4bad-a044-eb381bb82d01 tempest-CreateVolumesFromImageTest-1328511443 None] Deleted volume successfully. Jun 03 12:11:56 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-212abf71-b1f9-4bad-a044-eb381bb82d01 tempest-CreateVolumesFromImageTest-1328511443 None] Lock "cinder-f48391f3-0b6e-4c9e-a7da-0ace036e1702-delete_volume" released by "delete_volume" :: held 3.090s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:56 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c81a595b-3231-4b50-bcc1-72061ffc0a2d tempest-CreateVolumesFromImageTest-1328511443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1e6952a5-ed89-402d-a55b-01a34b9c7663" returned: 0 in 0.973s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c81a595b-3231-4b50-bcc1-72061ffc0a2d tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1e6952a5-ed89-402d-a55b-01a34b9c7663 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:56 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1e6952a5-ed89-402d-a55b-01a34b9c7663 Jun 03 12:11:56 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:56 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-913890b5-2b4d-4a64-ace3-ad1d8031616d tempest-CinderUnicodeTest-507854956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.911ef563-a562-4322-8893-762ca9fc9888" returned: 0 in 0.793s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-913890b5-2b4d-4a64-ace3-ad1d8031616d tempest-CinderUnicodeTest-507854956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:56 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.info Jun 03 12:11:56 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:56 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD" returned: 1 in 0.964s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:11:56 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Temporary image 310bad33-e5e4-47b6-94e2-bb659542fc09 is fetched for user 8a6242094a9644c4911aa514ea05eb3e. {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 03 12:11:56 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[48de6409-440e-4a7f-9967-eb6eea0bc483]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:56 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:57 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD Jun 03 12:11:57 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:57 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c81a595b-3231-4b50-bcc1-72061ffc0a2d tempest-CreateVolumesFromImageTest-1328511443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-1e6952a5-ed89-402d-a55b-01a34b9c7663" returned: 0 in 0.780s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:57 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c81a595b-3231-4b50-bcc1-72061ffc0a2d tempest-CreateVolumesFromImageTest-1328511443 None] Lock "cinder-quobyte-1e6952a5-ed89-402d-a55b-01a34b9c7663" released by "delete_volume" :: held 1.812s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:57 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-913890b5-2b4d-4a64-ace3-ad1d8031616d tempest-CinderUnicodeTest-507854956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.info" returned: 0 in 0.680s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:57 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-913890b5-2b4d-4a64-ace3-ad1d8031616d tempest-CinderUnicodeTest-507854956 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.info is being set with open permissions: ugo+rw Jun 03 12:11:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-913890b5-2b4d-4a64-ace3-ad1d8031616d tempest-CinderUnicodeTest-507854956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:57 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-c81a595b-3231-4b50-bcc1-72061ffc0a2d tempest-CreateVolumesFromImageTest-1328511443 None] Created reservations ['e4a37f98-5677-4f18-9dd4-dc85fe7a78ec', '7a006880-b4ff-4c8b-bb7a-ddfd6eeb7240', 'c604e7a2-bac5-48d4-b1cc-f4d9741fa376', 'e07dd12a-f77b-4ddd-8091-ed2c8efef8cc'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:11:57 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.info Jun 03 12:11:57 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c81a595b-3231-4b50-bcc1-72061ffc0a2d tempest-CreateVolumesFromImageTest-1328511443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c81a595b-3231-4b50-bcc1-72061ffc0a2d tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:57 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c81a595b-3231-4b50-bcc1-72061ffc0a2d tempest-CreateVolumesFromImageTest-1328511443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:57 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c81a595b-3231-4b50-bcc1-72061ffc0a2d tempest-CreateVolumesFromImageTest-1328511443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c81a595b-3231-4b50-bcc1-72061ffc0a2d tempest-CreateVolumesFromImageTest-1328511443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c81a595b-3231-4b50-bcc1-72061ffc0a2d tempest-CreateVolumesFromImageTest-1328511443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:57 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:11:57 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:57 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD" returned: 0 in 0.869s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:57 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:58 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD Jun 03 12:11:58 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:58 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:58 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-913890b5-2b4d-4a64-ace3-ad1d8031616d tempest-CinderUnicodeTest-507854956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.info" returned: 0 in 0.951s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-913890b5-2b4d-4a64-ace3-ad1d8031616d tempest-CinderUnicodeTest-507854956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.770s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c81a595b-3231-4b50-bcc1-72061ffc0a2d tempest-CreateVolumesFromImageTest-1328511443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.826s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:58 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-c81a595b-3231-4b50-bcc1-72061ffc0a2d tempest-CreateVolumesFromImageTest-1328511443 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:11:58 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c81a595b-3231-4b50-bcc1-72061ffc0a2d tempest-CreateVolumesFromImageTest-1328511443 None] Deleted volume successfully. Jun 03 12:11:58 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-913890b5-2b4d-4a64-ace3-ad1d8031616d tempest-CinderUnicodeTest-507854956 None] Create snapshot completed successfully Jun 03 12:11:58 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c81a595b-3231-4b50-bcc1-72061ffc0a2d tempest-CreateVolumesFromImageTest-1328511443 None] Lock "cinder-1e6952a5-ed89-402d-a55b-01a34b9c7663-delete_volume" released by "delete_volume" :: held 2.970s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:11:58 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jun 03 12:11:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD" returned: 1 in 1.017s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:11:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:11:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:58 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7caccf5-29ce-4609-a210-429092789bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c0f83cfd22c46cfb353592d2be19262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:11:54Z,use_quota=True,user_id='8a6242094a9644c4911aa514ea05eb3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:11:58 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Creating volume b7caccf5-29ce-4609-a210-429092789bdd {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:11:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:11:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:11:58 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:11:58 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:11:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:11:58 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:11:58 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:11:58 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:58 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd 1073741824 Jun 03 12:11:58 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:11:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] Acquiring lock "cinder-911ef563-a562-4322-8893-762ca9fc9888-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] Lock "cinder-911ef563-a562-4322-8893-762ca9fc9888-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] Acquiring lock "cinder-quobyte-88b733a0-62d9-4304-8b36-fb4bd544a277" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] Lock "cinder-quobyte-88b733a0-62d9-4304-8b36-fb4bd544a277" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] Acquiring lock "cinder-quobyte-911ef563-a562-4322-8893-762ca9fc9888" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:11:59 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] Lock "cinder-quobyte-911ef563-a562-4322-8893-762ca9fc9888" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:11:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] Deleting offline snapshot 911ef563-a562-4322-8893-762ca9fc9888 of volume 88b733a0-62d9-4304-8b36-fb4bd544a277 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 12:11:59 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] snapshot_file for this snap is: volume-88b733a0-62d9-4304-8b36-fb4bd544a277.911ef563-a562-4322-8893-762ca9fc9888 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 12:11:59 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc33594-ed07-49ae-852f-e07d491a11bb]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:11:59 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.911ef563-a562-4322-8893-762ca9fc9888 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:11:59 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.911ef563-a562-4322-8893-762ca9fc9888 Jun 03 12:11:59 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:00 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd 1073741824" returned: 0 in 1.281s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:00 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd Jun 03 12:12:00 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:00 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.911ef563-a562-4322-8893-762ca9fc9888" returned: 0 in 1.107s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88b733a0-62d9-4304-8b36-fb4bd544a277(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:12:00 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[850e9b9f-9064-470b-a8be-622290191e08]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:12:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:00 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277 Jun 03 12:12:00 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:00 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd" returned: 0 in 0.661s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:00 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:12:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:12:00 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Attempting download of 310bad33-e5e4-47b6-94e2-bb659542fc09 ((None, [{'url': 'file:///opt/stack/data/glance/images/310bad33-e5e4-47b6-94e2-bb659542fc09', 'metadata': {}}])) to volume b7caccf5-29ce-4609-a210-429092789bdd. {{(pid=86724) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 03 12:12:00 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[921ff4c4-3b68-4a2d-80d3-4b1ac46efd37]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:12:00 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_310bad33-e5e4-47b6-94e2-bb659542fc09_r_u921ap {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:01 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_310bad33-e5e4-47b6-94e2-bb659542fc09_r_u921ap Jun 03 12:12:01 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:01 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277" returned: 0 in 0.832s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.911ef563-a562-4322-8893-762ca9fc9888 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:01 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.911ef563-a562-4322-8893-762ca9fc9888 Jun 03 12:12:01 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:01 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_310bad33-e5e4-47b6-94e2-bb659542fc09_r_u921ap" returned: 0 in 0.749s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:01 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_310bad33-e5e4-47b6-94e2-bb659542fc09_r_u921ap {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:01 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_310bad33-e5e4-47b6-94e2-bb659542fc09_r_u921ap Jun 03 12:12:01 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:02 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.911ef563-a562-4322-8893-762ca9fc9888" returned: 0 in 1.077s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.911ef563-a562-4322-8893-762ca9fc9888 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:02 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.911ef563-a562-4322-8893-762ca9fc9888 Jun 03 12:12:02 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:02 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_310bad33-e5e4-47b6-94e2-bb659542fc09_r_u921ap" returned: 1 in 0.895s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_310bad33-e5e4-47b6-94e2-bb659542fc09_r_u921ap' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:12:02 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6692fb6b-4898-45d4-8d5b-63125e2bd364]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:12:02 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:02 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD Jun 03 12:12:02 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:03 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277.911ef563-a562-4322-8893-762ca9fc9888" returned: 0 in 0.802s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] Lock "cinder-quobyte-911ef563-a562-4322-8893-762ca9fc9888" released by "_delete_snapshot" :: held 3.990s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:12:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] Lock "cinder-quobyte-88b733a0-62d9-4304-8b36-fb4bd544a277" released by "delete_snapshot" :: held 4.028s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:12:03 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] Created reservations ['7bf2c76b-3f22-4071-81f7-3c9dc0fe1105', 'd353e745-cb3b-4017-aeda-7f3054233519', 'ebf08fb9-5bd0-4325-aa0e-66e7de5ceba9', 'dccdc5bb-b241-435c-9f11-2c4ac0ad3dd2'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:12:03 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] Delete snapshot completed successfully. Jun 03 12:12:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-c13bba94-fdb5-44e6-b082-9883ce098db7 tempest-CinderUnicodeTest-507854956 None] Lock "cinder-911ef563-a562-4322-8893-762ca9fc9888-delete_snapshot" released by "delete_snapshot" :: held 4.218s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:12:03 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD" returned: 0 in 0.756s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2ffa4cda-a303-49a0-b104-663b319ec036 tempest-CinderUnicodeTest-507854956 None] Acquiring lock "cinder-88b733a0-62d9-4304-8b36-fb4bd544a277-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:12:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2ffa4cda-a303-49a0-b104-663b319ec036 tempest-CinderUnicodeTest-507854956 None] Lock "cinder-88b733a0-62d9-4304-8b36-fb4bd544a277-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:12:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2ffa4cda-a303-49a0-b104-663b319ec036 tempest-CinderUnicodeTest-507854956 None] Acquiring lock "cinder-quobyte-88b733a0-62d9-4304-8b36-fb4bd544a277" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:12:03 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2ffa4cda-a303-49a0-b104-663b319ec036 tempest-CinderUnicodeTest-507854956 None] Lock "cinder-quobyte-88b733a0-62d9-4304-8b36-fb4bd544a277" acquired by "delete_volume" :: waited 0.025s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:12:03 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD Jun 03 12:12:03 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:03 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[283d2bf3-a0fe-4b8b-8517-0b7b426ed646]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:12:03 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2ffa4cda-a303-49a0-b104-663b319ec036 tempest-CinderUnicodeTest-507854956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:03 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277 Jun 03 12:12:03 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:04 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD" returned: 1 in 0.810s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:12:04 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] 310bad33-e5e4-47b6-94e2-bb659542fc09 was raw, converting to raw {{(pid=86724) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 03 12:12:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:04 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd Jun 03 12:12:04 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:04 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2ffa4cda-a303-49a0-b104-663b319ec036 tempest-CinderUnicodeTest-507854956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277" returned: 0 in 0.891s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:04 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2ffa4cda-a303-49a0-b104-663b319ec036 tempest-CinderUnicodeTest-507854956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:04 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277 Jun 03 12:12:04 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:05 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd" returned: 0 in 0.983s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:05 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_310bad33-e5e4-47b6-94e2-bb659542fc09_qjhsg2j2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 12:12:05 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Converted 0.00 MB image at 0.00 MB/s Jun 03 12:12:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:05 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd 1G Jun 03 12:12:05 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:05 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2ffa4cda-a303-49a0-b104-663b319ec036 tempest-CinderUnicodeTest-507854956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-88b733a0-62d9-4304-8b36-fb4bd544a277" returned: 0 in 0.844s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:05 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2ffa4cda-a303-49a0-b104-663b319ec036 tempest-CinderUnicodeTest-507854956 None] Lock "cinder-quobyte-88b733a0-62d9-4304-8b36-fb4bd544a277" released by "delete_volume" :: held 1.811s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:12:05 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-2ffa4cda-a303-49a0-b104-663b319ec036 tempest-CinderUnicodeTest-507854956 None] Created reservations ['e9f73011-9ecf-438c-91cd-aca76fa58d7a', 'b3f7e6bf-6a75-4920-be3a-893b030e6673', 'c20af9be-bdb6-4cec-9661-77ef89cfb9de', 'dbf49ea8-8318-45cd-8481-3c66934bf320'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:12:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2ffa4cda-a303-49a0-b104-663b319ec036 tempest-CinderUnicodeTest-507854956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:12:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2ffa4cda-a303-49a0-b104-663b319ec036 tempest-CinderUnicodeTest-507854956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:12:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2ffa4cda-a303-49a0-b104-663b319ec036 tempest-CinderUnicodeTest-507854956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:12:05 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-2ffa4cda-a303-49a0-b104-663b319ec036 tempest-CinderUnicodeTest-507854956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:12:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-2ffa4cda-a303-49a0-b104-663b319ec036 tempest-CinderUnicodeTest-507854956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:12:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2ffa4cda-a303-49a0-b104-663b319ec036 tempest-CinderUnicodeTest-507854956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:05 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:12:05 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:05 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b34166eb-38f6-4e8d-aceb-374e0444b34f tempest-CinderUnicodeTest-507854956 None] Acquiring lock "cinder-f2ecaeb7-8138-4c65-bad0-619bf3e3de74-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:12:05 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b34166eb-38f6-4e8d-aceb-374e0444b34f tempest-CinderUnicodeTest-507854956 None] Lock "cinder-f2ecaeb7-8138-4c65-bad0-619bf3e3de74-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:12:05 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b34166eb-38f6-4e8d-aceb-374e0444b34f tempest-CinderUnicodeTest-507854956 None] Acquiring lock "cinder-quobyte-f2ecaeb7-8138-4c65-bad0-619bf3e3de74" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:12:05 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b34166eb-38f6-4e8d-aceb-374e0444b34f tempest-CinderUnicodeTest-507854956 None] Lock "cinder-quobyte-f2ecaeb7-8138-4c65-bad0-619bf3e3de74" acquired by "delete_volume" :: waited 0.016s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:12:05 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b73652-5738-4a7e-9d09-b1eca9e2db2d]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:12:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b34166eb-38f6-4e8d-aceb-374e0444b34f tempest-CinderUnicodeTest-507854956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f2ecaeb7-8138-4c65-bad0-619bf3e3de74 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:05 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd 1G" returned: 0 in 0.760s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:05 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c0e633-1975-4884-a578-465e07aba84c]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:12:05 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:05 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f2ecaeb7-8138-4c65-bad0-619bf3e3de74 Jun 03 12:12:05 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:06 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd Jun 03 12:12:06 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:06 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-2ffa4cda-a303-49a0-b104-663b319ec036 tempest-CinderUnicodeTest-507854956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.740s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:06 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-2ffa4cda-a303-49a0-b104-663b319ec036 tempest-CinderUnicodeTest-507854956 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:12:06 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-2ffa4cda-a303-49a0-b104-663b319ec036 tempest-CinderUnicodeTest-507854956 None] Deleted volume successfully. Jun 03 12:12:06 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-2ffa4cda-a303-49a0-b104-663b319ec036 tempest-CinderUnicodeTest-507854956 None] Lock "cinder-88b733a0-62d9-4304-8b36-fb4bd544a277-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:12:06 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b34166eb-38f6-4e8d-aceb-374e0444b34f tempest-CinderUnicodeTest-507854956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f2ecaeb7-8138-4c65-bad0-619bf3e3de74" returned: 0 in 0.846s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b34166eb-38f6-4e8d-aceb-374e0444b34f tempest-CinderUnicodeTest-507854956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f2ecaeb7-8138-4c65-bad0-619bf3e3de74 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:06 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f2ecaeb7-8138-4c65-bad0-619bf3e3de74 Jun 03 12:12:06 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:06 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd" returned: 0 in 0.847s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:06 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:06 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd Jun 03 12:12:06 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:07 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b34166eb-38f6-4e8d-aceb-374e0444b34f tempest-CinderUnicodeTest-507854956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-f2ecaeb7-8138-4c65-bad0-619bf3e3de74" returned: 0 in 0.744s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:07 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b34166eb-38f6-4e8d-aceb-374e0444b34f tempest-CinderUnicodeTest-507854956 None] Lock "cinder-quobyte-f2ecaeb7-8138-4c65-bad0-619bf3e3de74" released by "delete_volume" :: held 1.652s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:12:07 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-b34166eb-38f6-4e8d-aceb-374e0444b34f tempest-CinderUnicodeTest-507854956 None] Created reservations ['978d7137-de82-44a5-baa8-8e3d02ecd0e9', '52f7da30-4096-4679-90a0-ecee241dbb2d', '0d1e65b1-c8c6-4229-9b0c-8ff7708f18d2', '12384fec-fb28-482f-b8fd-1bd1e1489559'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:12:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b34166eb-38f6-4e8d-aceb-374e0444b34f tempest-CinderUnicodeTest-507854956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:12:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b34166eb-38f6-4e8d-aceb-374e0444b34f tempest-CinderUnicodeTest-507854956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:12:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b34166eb-38f6-4e8d-aceb-374e0444b34f tempest-CinderUnicodeTest-507854956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:12:07 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-b34166eb-38f6-4e8d-aceb-374e0444b34f tempest-CinderUnicodeTest-507854956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:12:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-b34166eb-38f6-4e8d-aceb-374e0444b34f tempest-CinderUnicodeTest-507854956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:12:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b34166eb-38f6-4e8d-aceb-374e0444b34f tempest-CinderUnicodeTest-507854956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:07 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:12:07 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:07 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd" returned: 1 in 0.804s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:07 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:12:07 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Downloaded image 310bad33-e5e4-47b6-94e2-bb659542fc09 ((None, [{'url': 'file:///opt/stack/data/glance/images/310bad33-e5e4-47b6-94e2-bb659542fc09', 'metadata': {}}])) to volume b7caccf5-29ce-4609-a210-429092789bdd successfully. {{(pid=86724) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 03 12:12:07 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Temporary image 310bad33-e5e4-47b6-94e2-bb659542fc09 for user 8a6242094a9644c4911aa514ea05eb3e is deleted. {{(pid=86724) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 03 12:12:07 devstack cinder-volume[86724]: DEBUG cinder.volume.volume_utils [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Marking volume b7caccf5-29ce-4609-a210-429092789bdd as bootable. {{(pid=86724) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 03 12:12:07 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Copying metadata from image 310bad33-e5e4-47b6-94e2-bb659542fc09 to b7caccf5-29ce-4609-a210-429092789bdd. {{(pid=86724) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 03 12:12:07 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Creating volume glance metadata for volume b7caccf5-29ce-4609-a210-429092789bdd backed by image 310bad33-e5e4-47b6-94e2-bb659542fc09 with: {'image_id': '310bad33-e5e4-47b6-94e2-bb659542fc09', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f5bdec1f496934d3ff8b8cb9fa165358', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86724) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 03 12:12:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc72cea9-8d24-484d-9911-d5309c416742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7caccf5-29ce-4609-a210-429092789bdd', 'volume_size': 1, 'image_id': '310bad33-e5e4-47b6-94e2-bb659542fc09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/310bad33-e5e4-47b6-94e2-bb659542fc09', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f5bdec1f496934d3ff8b8cb9fa165358', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9c0f83cfd22c46cfb353592d2be19262', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bf39c3ffac245ae1bb81383652542ba912af3d35a3935b06aa606fa2bd2d90e9fcac01981c012cdd7e6f9b8295aa6417b02aa8352d9d467464674ac8744e2d67', 'id': '310bad33-e5e4-47b6-94e2-bb659542fc09', 'created_at': datetime.datetime(2026, 6, 3, 10, 11, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 3, 10, 11, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/310bad33-e5e4-47b6-94e2-bb659542fc09/file', 'properties': {}}, 'image_service': }' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:12:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240d4447-8506-446d-8cab-099dbf02494a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:12:07 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Volume volume-b7caccf5-29ce-4609-a210-429092789bdd (b7caccf5-29ce-4609-a210-429092789bdd): created successfully Jun 03 12:12:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240d4447-8506-446d-8cab-099dbf02494a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:12:07 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Flow 'volume_create_manager' (46d272f6-edd8-4d55-82ef-44ddc20e5bbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:12:07 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-c0107d19-1f4f-4375-ba5a-17ceb5cf093a tempest-VolumeImageDependencyTests-528052434 None] Created volume successfully. Jun 03 12:12:08 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-b34166eb-38f6-4e8d-aceb-374e0444b34f tempest-CinderUnicodeTest-507854956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.654s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:08 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-b34166eb-38f6-4e8d-aceb-374e0444b34f tempest-CinderUnicodeTest-507854956 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:12:08 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-b34166eb-38f6-4e8d-aceb-374e0444b34f tempest-CinderUnicodeTest-507854956 None] Deleted volume successfully. Jun 03 12:12:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-b34166eb-38f6-4e8d-aceb-374e0444b34f tempest-CinderUnicodeTest-507854956 None] Lock "cinder-f2ecaeb7-8138-4c65-bad0-619bf3e3de74-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:12:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] Acquiring lock "cinder-b7caccf5-29ce-4609-a210-429092789bdd-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:12:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] Lock "cinder-b7caccf5-29ce-4609-a210-429092789bdd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:12:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] Acquiring lock "cinder-quobyte-b7caccf5-29ce-4609-a210-429092789bdd" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:12:08 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] Lock "cinder-quobyte-b7caccf5-29ce-4609-a210-429092789bdd" acquired by "delete_volume" :: waited 0.018s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:12:08 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8acf18-728a-49bf-9d82-422b0d71198d]: (4, 'raw') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:12:08 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:08 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd Jun 03 12:12:08 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:09 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd" returned: 0 in 0.850s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:09 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:09 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd Jun 03 12:12:09 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:10 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd" returned: 1 in 0.847s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd' failed. Not Retrying. {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 12:12:10 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:10 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd Jun 03 12:12:10 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:11 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-b7caccf5-29ce-4609-a210-429092789bdd" returned: 0 in 0.658s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:11 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] Lock "cinder-quobyte-b7caccf5-29ce-4609-a210-429092789bdd" released by "delete_volume" :: held 2.438s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:12:11 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] Created reservations ['67b30a0a-74b0-4986-9307-135c9b41256e', 'b6d4e622-7500-4a9d-97ac-f0d099d6e934', 'a8db92ef-2af2-451e-b99d-f0922d0bd779', 'bd9c71a2-fb7e-464a-a5e9-14b048edab55'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:12:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:12:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:12:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:12:11 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:12:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:12:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:11 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:12:11 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:11 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:11 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.653s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:11 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:12:11 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] Deleted volume successfully. Jun 03 12:12:11 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-670f29fc-58af-4fea-a17b-900d4c2fa28a tempest-VolumeImageDependencyTests-528052434 None] Lock "cinder-b7caccf5-29ce-4609-a210-429092789bdd-delete_volume" released by "delete_volume" :: held 3.361s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Flow 'volume_create_manager' (de09f5aa-1aef-4d81-b0c5-ce9c40bf94cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed73935-95b9-4161-ad16-5529489fd7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed73935-95b9-4161-ad16-5529489fd7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-148339399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7b6fe6-8b25-452c-a830-1771508641cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990657d182634c7b936bcad0ddf5f49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:12:17Z,use_quota=True,user_id='b61c9710fdc148818fd39193d8be37ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1c1ea1-72f8-4211-bbb8-16ded36ea68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1c1ea1-72f8-4211-bbb8-16ded36ea68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e49323e-0d39-409e-b332-877ed2a45e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e49323e-0d39-409e-b332-877ed2a45e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc7b6fe6-8b25-452c-a830-1771508641cb', 'volume_name': 'volume-dc7b6fe6-8b25-452c-a830-1771508641cb', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4500dd9-290a-4832-8563-a9aa289f060c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4500dd9-290a-4832-8563-a9aa289f060c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203a096f-66c1-4d66-bfa9-d8e1934fa714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:12:17 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Volume dc7b6fe6-8b25-452c-a830-1771508641cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc7b6fe6-8b25-452c-a830-1771508641cb', 'volume_size': 1} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-148339399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7b6fe6-8b25-452c-a830-1771508641cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990657d182634c7b936bcad0ddf5f49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:12:17Z,use_quota=True,user_id='b61c9710fdc148818fd39193d8be37ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)}" {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Creating volume dc7b6fe6-8b25-452c-a830-1771508641cb {{(pid=86724) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:12:17 devstack cinder-volume[86724]: INFO cinder.volume.drivers.remotefs [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] casted to osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb 1073741824 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:17 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb 1073741824 Jun 03 12:12:17 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:17 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb 1073741824" returned: 0 in 0.752s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:17 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:17 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb Jun 03 12:12:17 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:18 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb" returned: 0 in 0.592s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:18 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'} {{(pid=86724) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 03 12:12:18 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:12:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203a096f-66c1-4d66-bfa9-d8e1934fa714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc7b6fe6-8b25-452c-a830-1771508641cb', 'volume_size': 1}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:12:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9c701d-36ab-4581-8ffa-fb2bc4b0e510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:12:18 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Volume volume-dc7b6fe6-8b25-452c-a830-1771508641cb (dc7b6fe6-8b25-452c-a830-1771508641cb): created successfully Jun 03 12:12:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9c701d-36ab-4581-8ffa-fb2bc4b0e510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:12:18 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Flow 'volume_create_manager' (de09f5aa-1aef-4d81-b0c5-ce9c40bf94cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:12:18 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-84ba23a8-9cd7-4bbe-90b6-c4ac21985edf tempest-SnapshotDependencyTests-983304609 None] Created volume successfully. Jun 03 12:12:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-880c7651-4825-4a5c-82d2-54245caaf315 tempest-SnapshotDependencyTests-983304609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:12:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-880c7651-4825-4a5c-82d2-54245caaf315 tempest-SnapshotDependencyTests-983304609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:12:19 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-880c7651-4825-4a5c-82d2-54245caaf315 tempest-SnapshotDependencyTests-983304609 None] Creating offline snapshot d7bf14c5-081b-4f4c-9010-e4149c913d51 of volume dc7b6fe6-8b25-452c-a830-1771508641cb {{(pid=86724) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 03 12:12:19 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[347b0167-bf17-49dc-8f95-172612a27874]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:12:19 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-880c7651-4825-4a5c-82d2-54245caaf315 tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:19 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb Jun 03 12:12:19 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:20 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-880c7651-4825-4a5c-82d2-54245caaf315 tempest-SnapshotDependencyTests-983304609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb" returned: 0 in 0.703s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-880c7651-4825-4a5c-82d2-54245caaf315 tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51 1G {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:20 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51 1G Jun 03 12:12:20 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:20 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-880c7651-4825-4a5c-82d2-54245caaf315 tempest-SnapshotDependencyTests-983304609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51 1G" returned: 0 in 0.802s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:20 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-880c7651-4825-4a5c-82d2-54245caaf315 tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc7b6fe6-8b25-452c-a830-1771508641cb -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:20 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc7b6fe6-8b25-452c-a830-1771508641cb -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51 Jun 03 12:12:20 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:21 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-880c7651-4825-4a5c-82d2-54245caaf315 tempest-SnapshotDependencyTests-983304609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc7b6fe6-8b25-452c-a830-1771508641cb -F qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51" returned: 0 in 0.637s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:21 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-880c7651-4825-4a5c-82d2-54245caaf315 tempest-SnapshotDependencyTests-983304609 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51 is being set with open permissions: ugo+rw Jun 03 12:12:21 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-880c7651-4825-4a5c-82d2-54245caaf315 tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:21 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51 Jun 03 12:12:21 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:22 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-880c7651-4825-4a5c-82d2-54245caaf315 tempest-SnapshotDependencyTests-983304609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51" returned: 0 in 0.590s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-880c7651-4825-4a5c-82d2-54245caaf315 tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:22 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.info Jun 03 12:12:22 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:22 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-880c7651-4825-4a5c-82d2-54245caaf315 tempest-SnapshotDependencyTests-983304609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.info" returned: 0 in 0.592s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:22 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-880c7651-4825-4a5c-82d2-54245caaf315 tempest-SnapshotDependencyTests-983304609 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.info is being set with open permissions: ugo+rw Jun 03 12:12:22 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-880c7651-4825-4a5c-82d2-54245caaf315 tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.info {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:22 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.info Jun 03 12:12:22 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:23 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-880c7651-4825-4a5c-82d2-54245caaf315 tempest-SnapshotDependencyTests-983304609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.info" returned: 0 in 0.580s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:23 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-880c7651-4825-4a5c-82d2-54245caaf315 tempest-SnapshotDependencyTests-983304609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.993s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:12:23 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-880c7651-4825-4a5c-82d2-54245caaf315 tempest-SnapshotDependencyTests-983304609 None] Create snapshot completed successfully Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86724) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Flow 'volume_create_manager' (daf6610b-b810-4fff-bf62-e5327ec1fcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad5e389-a0fb-46a1-a0e8-67fc703ff324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad5e389-a0fb-46a1-a0e8-67fc703ff324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-03T10:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3908e8d1-ca82-45dc-9af6-7a130ee2417c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990657d182634c7b936bcad0ddf5f49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-03T10:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d7bf14c5-081b-4f4c-9010-e4149c913d51,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-03T10:12:24Z,use_quota=True,user_id='b61c9710fdc148818fd39193d8be37ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba0cc0d-0502-4aca-a5db-79707ec07059),volume_type_id=cba0cc0d-0502-4aca-a5db-79707ec07059)' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8383e8c3-f1e1-4c65-a35f-f310a0b70302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8383e8c3-f1e1-4c65-a35f-f310a0b70302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e04e0b58-074a-4a20-86dc-5b6cbbd880b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e04e0b58-074a-4a20-86dc-5b6cbbd880b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3908e8d1-ca82-45dc-9af6-7a130ee2417c', 'volume_name': 'volume-3908e8d1-ca82-45dc-9af6-7a130ee2417c', 'volume_size': 1, 'snapshot_id': 'd7bf14c5-081b-4f4c-9010-e4149c913d51'}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2477825-fbbb-4a70-9665-13905b4a1870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2477825-fbbb-4a70-9665-13905b4a1870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7849e761-a012-4109-b4eb-bd1dbf378f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:12:24 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Volume 3908e8d1-ca82-45dc-9af6-7a130ee2417c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3908e8d1-ca82-45dc-9af6-7a130ee2417c', 'volume_size': 1, 'snapshot_id': 'd7bf14c5-081b-4f4c-9010-e4149c913d51'} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Acquiring lock "cinder-quobyte-d7bf14c5-081b-4f4c-9010-e4149c913d51-3908e8d1-ca82-45dc-9af6-7a130ee2417c" by "_create_volume_from_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Lock "cinder-quobyte-d7bf14c5-081b-4f4c-9010-e4149c913d51-3908e8d1-ca82-45dc-9af6-7a130ee2417c" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Creating volume 3908e8d1-ca82-45dc-9af6-7a130ee2417c from snapshot d7bf14c5-081b-4f4c-9010-e4149c913d51 {{(pid=86724) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Selected osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6 as target Quobyte volume. {{(pid=86724) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Acquiring lock "cinder-quobyte-3908e8d1-ca82-45dc-9af6-7a130ee2417c" by "_copy_volume_from_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Lock "cinder-quobyte-3908e8d1-ca82-45dc-9af6-7a130ee2417c" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] snapshot: d7bf14c5-081b-4f4c-9010-e4149c913d51, volume: 3908e8d1-ca82-45dc-9af6-7a130ee2417c, {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3c2370-3d2a-44b9-93c7-964fb9fabda0]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:24 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51 Jun 03 12:12:24 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:24 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51" returned: 0 in 0.713s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc7b6fe6-8b25-452c-a830-1771508641cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] will copy from snapshot at /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Creating direct copy from snapshot {{(pid=86724) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[af64a47e-7355-401f-9cee-e650d1d1de38]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:12:24 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:25 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb Jun 03 12:12:25 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:25 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb" returned: 0 in 0.698s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:25 devstack cinder-volume[86724]: DEBUG cinder.utils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Path /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3908e8d1-ca82-45dc-9af6-7a130ee2417c not found in is_blk_device check {{(pid=86724) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 03 12:12:25 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3908e8d1-ca82-45dc-9af6-7a130ee2417c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:25 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3908e8d1-ca82-45dc-9af6-7a130ee2417c Jun 03 12:12:25 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:30 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3908e8d1-ca82-45dc-9af6-7a130ee2417c" returned: 0 in 4.428s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:30 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[de20b520-621b-468f-8281-c20c3f7f5f5d]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:12:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:30 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb Jun 03 12:12:30 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:30 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb" returned: 0 in 0.844s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:30 devstack cinder-volume[86724]: DEBUG cinder.image.image_utils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Image conversion details: src /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb, size 1024.00 MB, duration 4.43 sec, destination /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3908e8d1-ca82-45dc-9af6-7a130ee2417c {{(pid=86724) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 03 12:12:30 devstack cinder-volume[86724]: INFO cinder.image.image_utils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Converted 1024.00 MB image at 231.21 MB/s Jun 03 12:12:30 devstack cinder-volume[86724]: WARNING cinder.volume.drivers.remotefs [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3908e8d1-ca82-45dc-9af6-7a130ee2417c is being set with open permissions: ugo+rw Jun 03 12:12:30 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3908e8d1-ca82-45dc-9af6-7a130ee2417c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:30 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3908e8d1-ca82-45dc-9af6-7a130ee2417c Jun 03 12:12:30 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:31 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3908e8d1-ca82-45dc-9af6-7a130ee2417c" returned: 0 in 0.632s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:31 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Lock "cinder-quobyte-3908e8d1-ca82-45dc-9af6-7a130ee2417c" released by "_copy_volume_from_snapshot" :: held 7.410s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:12:31 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Lock "cinder-quobyte-d7bf14c5-081b-4f4c-9010-e4149c913d51-3908e8d1-ca82-45dc-9af6-7a130ee2417c" released by "_create_volume_from_snapshot" :: held 7.443s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:12:31 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.459s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:12:31 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7849e761-a012-4109-b4eb-bd1dbf378f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3908e8d1-ca82-45dc-9af6-7a130ee2417c', 'volume_size': 1, 'snapshot_id': 'd7bf14c5-081b-4f4c-9010-e4149c913d51'}' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:12:31 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc7a98c-8e42-405b-ab0c-082238388e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 03 12:12:31 devstack cinder-volume[86724]: INFO cinder.volume.flows.manager.create_volume [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Volume volume-3908e8d1-ca82-45dc-9af6-7a130ee2417c (3908e8d1-ca82-45dc-9af6-7a130ee2417c): created successfully Jun 03 12:12:31 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc7a98c-8e42-405b-ab0c-082238388e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86724) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 03 12:12:31 devstack cinder-volume[86724]: DEBUG cinder.volume.manager [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Flow 'volume_create_manager' (daf6610b-b810-4fff-bf62-e5327ec1fcd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86724) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 03 12:12:31 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-7cbfa1bb-77cf-476c-a9d5-7441f4e7aca8 tempest-SnapshotDependencyTests-983304609 None] Created volume successfully. Jun 03 12:12:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] Acquiring lock "cinder-d7bf14c5-081b-4f4c-9010-e4149c913d51-delete_snapshot" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:12:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] Lock "cinder-d7bf14c5-081b-4f4c-9010-e4149c913d51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:12:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] Acquiring lock "cinder-quobyte-dc7b6fe6-8b25-452c-a830-1771508641cb" by "delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:12:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] Lock "cinder-quobyte-dc7b6fe6-8b25-452c-a830-1771508641cb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:12:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] Acquiring lock "cinder-quobyte-d7bf14c5-081b-4f4c-9010-e4149c913d51" by "_delete_snapshot" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:12:32 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] Lock "cinder-quobyte-d7bf14c5-081b-4f4c-9010-e4149c913d51" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:12:32 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] Deleting offline snapshot d7bf14c5-081b-4f4c-9010-e4149c913d51 of volume dc7b6fe6-8b25-452c-a830-1771508641cb {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 03 12:12:32 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] snapshot_file for this snap is: volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51 {{(pid=86724) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 03 12:12:32 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a84909a-e9b3-49bd-8d60-657b9d86f8c9]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:12:32 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:33 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51 Jun 03 12:12:33 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:33 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51" returned: 0 in 0.706s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:33 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.remotefs [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc7b6fe6-8b25-452c-a830-1771508641cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86724) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 03 12:12:33 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfad63d-2271-490c-9165-dd9dd3460e56]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:12:33 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:33 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb Jun 03 12:12:33 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:34 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb" returned: 0 in 0.716s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:34 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:34 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51 Jun 03 12:12:34 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:35 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51" returned: 0 in 0.671s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:35 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51 Jun 03 12:12:35 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:35 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:35 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb.d7bf14c5-081b-4f4c-9010-e4149c913d51" returned: 0 in 0.591s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:35 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] Lock "cinder-quobyte-d7bf14c5-081b-4f4c-9010-e4149c913d51" released by "_delete_snapshot" :: held 2.785s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:12:35 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] Lock "cinder-quobyte-dc7b6fe6-8b25-452c-a830-1771508641cb" released by "delete_snapshot" :: held 2.808s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:12:35 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] Created reservations ['eb59edf8-0440-471a-80bc-df156b9ab433', '3e43e0d7-22e2-4331-9303-d6a39c9a4d6e', '9d5c1baa-6514-44d2-91a2-913f0ab0ed84', '40719057-4aec-48f3-8076-9b1ca7c63387'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:12:35 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] Delete snapshot completed successfully. Jun 03 12:12:35 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-a05b3e1f-b47c-406b-b513-3cc5f3e9bda1 tempest-SnapshotDependencyTests-983304609 None] Lock "cinder-d7bf14c5-081b-4f4c-9010-e4149c913d51-delete_snapshot" released by "delete_snapshot" :: held 2.933s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:12:36 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-197a84b9-1820-42e9-b3b6-d76cdf38eac2 tempest-SnapshotDependencyTests-983304609 None] Acquiring lock "cinder-dc7b6fe6-8b25-452c-a830-1771508641cb-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:12:36 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-197a84b9-1820-42e9-b3b6-d76cdf38eac2 tempest-SnapshotDependencyTests-983304609 None] Lock "cinder-dc7b6fe6-8b25-452c-a830-1771508641cb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:12:36 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-197a84b9-1820-42e9-b3b6-d76cdf38eac2 tempest-SnapshotDependencyTests-983304609 None] Acquiring lock "cinder-quobyte-dc7b6fe6-8b25-452c-a830-1771508641cb" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:12:36 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-197a84b9-1820-42e9-b3b6-d76cdf38eac2 tempest-SnapshotDependencyTests-983304609 None] Lock "cinder-quobyte-dc7b6fe6-8b25-452c-a830-1771508641cb" acquired by "delete_volume" :: waited 0.014s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:12:36 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6279b18d-abc2-4d1c-9aa6-b58202aff4cf]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:12:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-197a84b9-1820-42e9-b3b6-d76cdf38eac2 tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:36 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb Jun 03 12:12:36 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:36 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-197a84b9-1820-42e9-b3b6-d76cdf38eac2 tempest-SnapshotDependencyTests-983304609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb" returned: 0 in 0.713s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-197a84b9-1820-42e9-b3b6-d76cdf38eac2 tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:36 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb Jun 03 12:12:36 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:36 devstack cinder-volume[86724]: DEBUG oslo_service.periodic_task [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86724) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 03 12:12:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:12:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:12:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:12:36 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:12:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:12:36 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:37 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:12:37 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:37 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-197a84b9-1820-42e9-b3b6-d76cdf38eac2 tempest-SnapshotDependencyTests-983304609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-dc7b6fe6-8b25-452c-a830-1771508641cb" returned: 0 in 0.604s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:37 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-197a84b9-1820-42e9-b3b6-d76cdf38eac2 tempest-SnapshotDependencyTests-983304609 None] Lock "cinder-quobyte-dc7b6fe6-8b25-452c-a830-1771508641cb" released by "delete_volume" :: held 1.376s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:12:37 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-197a84b9-1820-42e9-b3b6-d76cdf38eac2 tempest-SnapshotDependencyTests-983304609 None] Created reservations ['8cc984c0-60a2-4b14-9904-1fe31a38cb38', '3e58a873-7685-4090-b72b-4fc5a826961d', 'cb89635f-d59d-43ca-b205-ba7bf0b639c3', '7635b609-c310-4743-ab2f-c8c3460df746'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:12:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-197a84b9-1820-42e9-b3b6-d76cdf38eac2 tempest-SnapshotDependencyTests-983304609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:12:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-197a84b9-1820-42e9-b3b6-d76cdf38eac2 tempest-SnapshotDependencyTests-983304609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:12:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-197a84b9-1820-42e9-b3b6-d76cdf38eac2 tempest-SnapshotDependencyTests-983304609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:12:37 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:37 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-197a84b9-1820-42e9-b3b6-d76cdf38eac2 tempest-SnapshotDependencyTests-983304609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:12:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-197a84b9-1820-42e9-b3b6-d76cdf38eac2 tempest-SnapshotDependencyTests-983304609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:12:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-197a84b9-1820-42e9-b3b6-d76cdf38eac2 tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:37 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.607s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:37 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-5faa5d95-bf37-4985-aab2-80534b5dcbee None None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:12:37 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:12:37 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:38 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-197a84b9-1820-42e9-b3b6-d76cdf38eac2 tempest-SnapshotDependencyTests-983304609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.598s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:38 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-197a84b9-1820-42e9-b3b6-d76cdf38eac2 tempest-SnapshotDependencyTests-983304609 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:12:38 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-197a84b9-1820-42e9-b3b6-d76cdf38eac2 tempest-SnapshotDependencyTests-983304609 None] Deleted volume successfully. Jun 03 12:12:38 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-197a84b9-1820-42e9-b3b6-d76cdf38eac2 tempest-SnapshotDependencyTests-983304609 None] Lock "cinder-dc7b6fe6-8b25-452c-a830-1771508641cb-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:12:38 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e5c46b77-49e2-4344-b9bd-5b7df719c033 tempest-SnapshotDependencyTests-983304609 None] Acquiring lock "cinder-3908e8d1-ca82-45dc-9af6-7a130ee2417c-delete_volume" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:12:38 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e5c46b77-49e2-4344-b9bd-5b7df719c033 tempest-SnapshotDependencyTests-983304609 None] Lock "cinder-3908e8d1-ca82-45dc-9af6-7a130ee2417c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:12:38 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e5c46b77-49e2-4344-b9bd-5b7df719c033 tempest-SnapshotDependencyTests-983304609 None] Acquiring lock "cinder-quobyte-3908e8d1-ca82-45dc-9af6-7a130ee2417c" by "delete_volume" {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 03 12:12:38 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e5c46b77-49e2-4344-b9bd-5b7df719c033 tempest-SnapshotDependencyTests-983304609 None] Lock "cinder-quobyte-3908e8d1-ca82-45dc-9af6-7a130ee2417c" acquired by "delete_volume" :: waited 0.016s {{(pid=86724) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 03 12:12:38 devstack cinder-volume[86724]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba487b9-b960-4d50-b05a-ea7dff0901ab]: (4, 'qcow2') {{(pid=87943) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 03 12:12:38 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e5c46b77-49e2-4344-b9bd-5b7df719c033 tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3908e8d1-ca82-45dc-9af6-7a130ee2417c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:38 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3908e8d1-ca82-45dc-9af6-7a130ee2417c Jun 03 12:12:38 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:39 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e5c46b77-49e2-4344-b9bd-5b7df719c033 tempest-SnapshotDependencyTests-983304609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3908e8d1-ca82-45dc-9af6-7a130ee2417c" returned: 0 in 0.700s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e5c46b77-49e2-4344-b9bd-5b7df719c033 tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3908e8d1-ca82-45dc-9af6-7a130ee2417c {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:39 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3908e8d1-ca82-45dc-9af6-7a130ee2417c Jun 03 12:12:39 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:39 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e5c46b77-49e2-4344-b9bd-5b7df719c033 tempest-SnapshotDependencyTests-983304609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20/volume-3908e8d1-ca82-45dc-9af6-7a130ee2417c" returned: 0 in 0.600s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:39 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e5c46b77-49e2-4344-b9bd-5b7df719c033 tempest-SnapshotDependencyTests-983304609 None] Lock "cinder-quobyte-3908e8d1-ca82-45dc-9af6-7a130ee2417c" released by "delete_volume" :: held 1.340s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:12:39 devstack cinder-volume[86724]: DEBUG cinder.quota [None req-e5c46b77-49e2-4344-b9bd-5b7df719c033 tempest-SnapshotDependencyTests-983304609 None] Created reservations ['0eea2c43-169c-4f78-bf89-d247913a531f', '31cad31f-5471-4579-8673-98df8c8a86af', 'cbbcd7cb-33f2-4675-9d66-8b1c01a9c802', '2b012b06-b6d3-427c-8be9-571c64d1c1d8'] {{(pid=86724) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 03 12:12:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e5c46b77-49e2-4344-b9bd-5b7df719c033 tempest-SnapshotDependencyTests-983304609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 03 12:12:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e5c46b77-49e2-4344-b9bd-5b7df719c033 tempest-SnapshotDependencyTests-983304609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 03 12:12:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e5c46b77-49e2-4344-b9bd-5b7df719c033 tempest-SnapshotDependencyTests-983304609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6': None} {{(pid=86724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 03 12:12:39 devstack cinder-volume[86724]: DEBUG cinder.volume.drivers.quobyte [None req-e5c46b77-49e2-4344-b9bd-5b7df719c033 tempest-SnapshotDependencyTests-983304609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1683841a-48ab-47fa-b3b4-d2e2d70c79d6'] {{(pid=86724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 03 12:12:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.lockutils [None req-e5c46b77-49e2-4344-b9bd-5b7df719c033 tempest-SnapshotDependencyTests-983304609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 03 12:12:39 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e5c46b77-49e2-4344-b9bd-5b7df719c033 tempest-SnapshotDependencyTests-983304609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 12:12:39 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20 Jun 03 12:12:39 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 03 12:12:40 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jun 03 12:12:40 devstack cinder-volume[86724]: DEBUG oslo_concurrency.processutils [None req-e5c46b77-49e2-4344-b9bd-5b7df719c033 tempest-SnapshotDependencyTests-983304609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/22f1d92f09053a0f0cc7a5dd068a1d20" returned: 0 in 0.591s {{(pid=86724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 12:12:40 devstack cinder-volume[86724]: DEBUG cinder.manager [None req-e5c46b77-49e2-4344-b9bd-5b7df719c033 tempest-SnapshotDependencyTests-983304609 None] Notifying Schedulers of capabilities ... {{(pid=86724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 03 12:12:40 devstack cinder-volume[86724]: INFO cinder.volume.manager [None req-e5c46b77-49e2-4344-b9bd-5b7df719c033 tempest-SnapshotDependencyTests-983304609 None] Deleted volume successfully. Jun 03 12:12:40 devstack cinder-volume[86724]: DEBUG cinder.coordination [None req-e5c46b77-49e2-4344-b9bd-5b7df719c033 tempest-SnapshotDependencyTests-983304609 None] Lock "cinder-3908e8d1-ca82-45dc-9af6-7a130ee2417c-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=86724) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 03 12:12:49 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:SELECT=92,cinder:INSERT=29,cinder:UPDATE=127,cinder:DELETE=10 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 03 12:12:50 devstack cinder-volume[86724]: DEBUG dbcounter [-] [86724] Writing DB stats cinder:UPDATE=104,cinder:INSERT=38,cinder:DELETE=8,cinder:SELECT=79 {{(pid=86724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}